{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Implementing CLSM"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Purpose\n",
    "The purpose of this notebook is to implement Microsoft's [Convolutional Latent Semantic Model](http://www.iro.umontreal.ca/~lisa/pointeurs/ir0895-he-2.pdf) on our dataset.\n",
    "\n",
    "## Inputs\n",
    "- This notebook requires *wiki-pages* from the FEVER dataset as an input."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Preprocessing Data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "import cdssm\n",
    "import numpy as np\n",
    "import nltk\n",
    "import utils\n",
    "import pickle\n",
    "\n",
    "from scipy import sparse\n",
    "from joblib import Parallel, delayed\n",
    "from multiprocessing import cpu_count\n",
    "from sklearn.preprocessing import OneHotEncoder, LabelEncoder\n",
    "from tqdm import tqdm_notebook"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Num Distinct Claims 109810\n",
      "Num Data Points 125051\n"
     ]
    }
   ],
   "source": [
    "claims, labels, article_list, claim_set, claim_to_article = utils.extract_fever_jsonl_data(\"../train.jsonl\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'Robert F. Kennedy defeated Senator Eugene McCarthy in the Ohio primaries.': ['robert f  kennedy'],\n",
       " 'The Odyssey has been translated into ancient dialects.': ['odyssey'],\n",
       " 'Big Bang won 7 awards at the 9th MTV Video Music Awards Japan.': ['big bang  south korean band '],\n",
       " 'Priyanka Chopra is an Indian singer.': ['priyanka chopra',\n",
       "  'priyanka chopra'],\n",
       " 'Oz the Great and Powerful was released in conventional theaters 2016.': ['oz the great and powerful'],\n",
       " 'Cosmopolitan contains content as of 2011 which includes articles on celebrities.': ['cosmopolitan  magazine '],\n",
       " 'One Teen Choice Award was won by Anne Hathaway.': ['anne hathaway'],\n",
       " 'Star Wars: Episode II – Attack of the Clones came out on Blu-ray disc.': ['star wars colon  episode ii – attack of the clones'],\n",
       " '24 premiered in November.': ['24  tv series '],\n",
       " 'Jane Eyre was originally published as Jane Eyre: An Autobiography.': ['jane eyre'],\n",
       " 'Emily Browning was passed over for a role in Sucker Punch.': ['emily browning'],\n",
       " 'Athena is an Norse goddess.': ['athena'],\n",
       " 'Hayden Panettiere is not an actress.': ['hayden panettiere'],\n",
       " 'The director of the pilot episode of The Blacklist was born in 1969.': ['the blacklist  tv series ',\n",
       "  'joe carnahan'],\n",
       " 'Florence Pugh had a role in The Falling.': ['the falling  2014 film '],\n",
       " 'Gabourey Sidibe made her acting debut in House of Lies.': ['gabourey sidibe'],\n",
       " 'William Jennings Bryan had a job.': ['william jennings bryan'],\n",
       " \"Michael Jackson's sexual abuse accusation was settled without criminal charges.\": ['michael jackson'],\n",
       " 'Chloë Sevigny stars in Love & Friendship.': ['love   friendship'],\n",
       " 'Darth Vader is the leader of the Galactic Empire.': ['darth vader'],\n",
       " 'Don Simpson and Jerry Bruckheimer produced Top Gun.': ['don simpson'],\n",
       " 'Nina Simone went to school some time after 1356.': ['nina simone'],\n",
       " 'Ranbir Kapoor is one of the highest-paid swimmers in India.': ['ranbir kapoor'],\n",
       " 'Harmanpreet Kaur was born on March 8.': ['harmanpreet kaur'],\n",
       " 'Semitic languages are used in the Horn of Africa.': ['semitic languages'],\n",
       " 'Bradford is in France.': ['bradford'],\n",
       " 'The French Revolution provoked changes.': ['french revolution'],\n",
       " 'Tyrese Gibson is well known for his role as Joseph \"Jody\" Summers in Baby Boy.': ['tyrese gibson',\n",
       "  'tyrese gibson'],\n",
       " 'Don Henley and Glenn Frey cowrote most Eagles songs.': ['glenn frey'],\n",
       " 'The Chronicles of Narnia is a series of films.': ['the chronicles of narnia  film series '],\n",
       " 'The Craft is a movie of the supernatural horror genres.': ['the craft  film '],\n",
       " 'Atomic Blonde is based on The Coldest City.': ['atomic blonde',\n",
       "  'atomic blonde'],\n",
       " 'Previously unknown athletes get a chance to shine at the Olympic Games.': ['olympic games'],\n",
       " 'Thailand is smaller than 49 other countries, with a total area of approximately 513,000 square kilometers.': ['thailand'],\n",
       " 'Daniel Craig was born in 1991.': ['daniel craig'],\n",
       " 'Unforgettable was written by Christina Hodson and David Leslie Johnson.': ['unforgettable  2017 film '],\n",
       " 'Mel Brooks is an entertainer.': ['mel brooks'],\n",
       " 'Billy Joel is in the performing arts industry.': ['billy joel'],\n",
       " 'Tony Bill directed a film written by anyone except Alan Ormsby.': ['tony bill',\n",
       "  'my bodyguard'],\n",
       " 'Nas is a musician who has received acclaim.': ['nas'],\n",
       " 'Austria signed the Austrian State Treaty in 1066.': ['austria'],\n",
       " 'Led Zeppelin II was produced by Led Zeppelin.': ['led zeppelin ii'],\n",
       " 'George Washington did not contribute to the establishment of the United States of America.': ['george washington'],\n",
       " 'The 1998 Major League Baseball All-Star Game was held at the home of the Colorado Rockies, Coors Field.': ['1998 major league baseball all star game'],\n",
       " \"Charlie Chaplin's childhood was one of destitution.\": ['charlie chaplin'],\n",
       " 'Ted Kaczynski sent a letter to a newspaper.': ['ted kaczynski',\n",
       "  'the new york times'],\n",
       " 'There is healthcare and education in North Korea.': ['north korea'],\n",
       " 'The Danish Girl is based on a 2011 novel by David Ebershoff.': ['the danish girl  film '],\n",
       " 'Abraham Lincoln helped to build the new Republican Party.': ['abraham lincoln'],\n",
       " \"Hayley Atwell's date of birth is April 5th, 1982.\": ['hayley atwell'],\n",
       " 'Lost Highway (film) was written by American director David Lynch.': ['lost highway  film '],\n",
       " \"Elephants' habitats include lions.\": ['elephant'],\n",
       " 'Angelina Jolie played a female character based on a video game.': ['angelina jolie'],\n",
       " 'Nick Kroll has been in the cast of comedy films.': ['nick kroll',\n",
       "  'a good old fashioned orgy',\n",
       "  'adult beginners',\n",
       "  'date night',\n",
       "  'dinner for schmucks',\n",
       "  'get him to the greek',\n",
       "  'joshy  film '],\n",
       " 'Ronald Reagan is still in office.': ['ronald reagan'],\n",
       " 'Clint Eastwood is a person who acts.': ['clint eastwood'],\n",
       " 'José María Chacón only surrendered the island of Trinidad to an American fleet.': ['josé maría chacón'],\n",
       " 'Andrew Wood (singer) is a singer.': ['andrew wood  singer '],\n",
       " 'Emily Ratajkowski was born in London.': ['emily ratajkowski'],\n",
       " \"Lisa Kudrow was in Romy and Michele's High School Reunion.\": ['lisa kudrow'],\n",
       " \"British Columbia's economic mainstay is logging, farming, and mining.\": ['british columbia'],\n",
       " 'Ruth Negga has worked in television in the United Kingdom.': ['ruth negga',\n",
       "  'bbc'],\n",
       " 'Nina Simone supported the Civil Rights Movement.': ['nina simone'],\n",
       " 'Caroline, Princess of Hanover is married to a man.': ['caroline  princess of hanover'],\n",
       " 'Glamorous is a song.': ['glamorous  fergie song '],\n",
       " 'Valerian and the City of a Thousand Planets stars an actor.': ['valerian and the city of a thousand planets',\n",
       "  'dane dehaan'],\n",
       " \"Kirk Douglas's professions include actor, producer, director, and author.\": ['kirk douglas'],\n",
       " 'Jeremy Allen White is an American television director.': ['jeremy allen white'],\n",
       " 'There is a Christian state called England.': ['christian state'],\n",
       " 'Ancient Egypt began in 3150 BC under the first pharaoh, Narmer.': ['ancient egypt'],\n",
       " 'Ty Cobb spent 22 seasons with the Dallas Cowboys.': ['ty cobb'],\n",
       " 'John Lennon was inducted into the Rock and Roll Hall of Fame multiple times.': ['john lennon'],\n",
       " 'Veronica Mars is a character.': ['veronica mars  character ',\n",
       "  'character  arts '],\n",
       " 'David Carradine starred in the television series Kung Fu in the 1970s.': ['david carradine'],\n",
       " 'Vanilla Sky stars an actress from Spain.': ['vanilla sky', 'penélope cruz'],\n",
       " 'Alison Brie is American.': ['alison brie'],\n",
       " \"Prison Break was the winner of a People's Choice Award.\": ['prison break'],\n",
       " 'The 2016 Summer Olympics was not a sport event.': ['2016 summer olympics'],\n",
       " 'Trent Reznor is a performer.': ['trent reznor'],\n",
       " 'The only thing seminary prepares its students for is a career in information sciences.': ['seminary'],\n",
       " 'Fifty Shades of Grey has been translated into 52 languages.': ['fifty shades of grey'],\n",
       " 'Tanzania does not have a parliamentary system.': ['tanzania'],\n",
       " 'In 2017, the 7th season of Game of Thrones came out.': ['game of thrones'],\n",
       " 'The Weeknd is a Canadian person.': ['the weeknd'],\n",
       " \"The Great Debaters' cast includes Forest Whitaker.\": ['the great debaters'],\n",
       " 'Black Mirror was first broadcast on CBS.': ['black mirror'],\n",
       " 'Outlander is based on the Outlander series.': ['outlander  tv series '],\n",
       " 'The Olympic Games give athletes the chance to attain fame both nationally and internationally.': ['olympic games'],\n",
       " 'Broadchurch is not a television crime drama.': ['broadchurch'],\n",
       " 'Azerbaijan was the earliest democratic republic in the Muslim world.': ['azerbaijan'],\n",
       " 'Apple was incorporated as Apple Computer, Inc. in January 1977.': ['apple inc '],\n",
       " 'Dracula was a vampire.': ['dracula'],\n",
       " 'Investment funds is the universal term for this type of investment.': ['investment fund'],\n",
       " 'The Philippines refused to make the national fruit a mango.': ['mango'],\n",
       " 'There is an American film named The Crazies.': ['the crazies  2010 film '],\n",
       " 'The Supremes were a girl group in the 1960s.': ['the supremes'],\n",
       " 'Colombia is in North America.': ['colombia'],\n",
       " 'Hisense only used the brand name of a former Chinese firm.': ['hisense'],\n",
       " 'Laurence Olivier was a self-governing actor-manager.': ['laurence olivier'],\n",
       " \"Tall Story's actress Jane Fonda was 22 years old during filming.\": ['tall story'],\n",
       " 'Zeus was the king of pants.': ['zeus'],\n",
       " 'Tim Robbins failed to ever have a career producing.': ['tim robbins'],\n",
       " 'Bradford contains a museum.': ['bradford'],\n",
       " 'Michael Fassbender appeared in a 2013 British-American thriller film.': ['michael fassbender',\n",
       "  'the counselor'],\n",
       " 'Marion Cotillard played a French cabaret singer in La Vie en Rose (2007).': ['marion cotillard',\n",
       "  'édith piaf'],\n",
       " 'Stars Dance is only a single.': ['stars dance'],\n",
       " 'Ghost in the Shell was developed by a company.': ['ghost in the shell  video game ',\n",
       "  'production i g'],\n",
       " 'Stranger Things includes a character who is capable of psychokinesis.': ['stranger things'],\n",
       " 'There are zero bodies of water in Ontario.': ['ontario',\n",
       "  'ontario',\n",
       "  'ontario',\n",
       "  'ontario',\n",
       "  'ontario',\n",
       "  'ontario',\n",
       "  'ontario'],\n",
       " 'Mike Myers had a small role in a 2009 fantasy film.': ['mike myers',\n",
       "  'inglourious basterds'],\n",
       " 'Calling All the Monsters was found through an American record label.': ['calling all the monsters',\n",
       "  'walt disney records'],\n",
       " 'Deadpool appears in Marvel Comics.': ['deadpool'],\n",
       " 'Judith Quiney passed away on February 9, 1662.': ['judith quiney'],\n",
       " 'Wyatt Earp was a hunter.': ['wyatt earp'],\n",
       " 'George Bernard Shaw wrote the novel Major Barbara.': ['george bernard shaw'],\n",
       " 'Performance (film) is the singing debut of Mick Jagger.': ['performance  film ',\n",
       "  'the rolling stones'],\n",
       " 'Howard Hughes built the Hughes H-1 Racer in the 1930s.': ['howard hughes'],\n",
       " 'Jordan Knight was born on May 17, 1950.': ['jordan knight'],\n",
       " 'Robert Carlock worked on Whiskey Tango Foxtrot.': ['whiskey tango foxtrot  film '],\n",
       " 'Iron Fist was created for Hulu.': ['iron fist  tv series '],\n",
       " 'Black Sabbath only formed in 1942.': ['black sabbath'],\n",
       " 'Khal Drogo was introduced in a novel.': ['khal drogo', 'a game of thrones'],\n",
       " 'Plutonium only reacts with iron.': ['plutonium', 'plutonium'],\n",
       " 'Jennifer Grey is incapable of being an actress.': ['jennifer grey'],\n",
       " 'Jackie Evancho was a model.': ['jackie evancho'],\n",
       " 'Adolf Hitler caused the murder of at least 5.5 million Jews.': ['adolf hitler'],\n",
       " 'Moses Malone won an MVP in 1982.': ['moses malone'],\n",
       " 'Julie Walters was in series.': ['julie walters',\n",
       "  'julie walters',\n",
       "  'julie walters',\n",
       "  'julie walters'],\n",
       " 'Maria Sharapova retired from tennis by 2000.': ['maria sharapova',\n",
       "  'list of wta number 1 ranked tennis players'],\n",
       " 'Alan Rickman was born in 1946.': ['alan rickman'],\n",
       " 'Roy Whiting was born on January 26, 1959.': ['roy whiting'],\n",
       " 'Bangalore was run by the Maharaja of Mysore.': ['bangalore'],\n",
       " 'Stay was released by Alessia Cara.': ['alessia cara',\n",
       "  'stay  zedd and alessia cara song '],\n",
       " 'Belgium is comprised of three regions.': ['belgium'],\n",
       " 'Taylor Schilling made her film debut after 2001.': ['taylor schilling',\n",
       "  'dark matter  film '],\n",
       " 'William Shakespeare did not write tragicomedies.': ['william shakespeare'],\n",
       " 'Nelson Mandela is without a middle name.': ['nelson mandela'],\n",
       " 'Sansa Stark was destroyed by an author.': ['sansa stark'],\n",
       " 'The occupation of Austria ended in 1955.': ['austria'],\n",
       " 'Hearing loss may be caused by birth complications.': ['hearing loss'],\n",
       " 'The Promise has a Dutch director.': ['the promise  2016 film ',\n",
       "  'terry george'],\n",
       " 'Augusto Pinochet died in 2016.': ['augusto pinochet'],\n",
       " 'The Breakfast Club was directed by Angela Merkel.': ['the breakfast club'],\n",
       " \"Sindh borders India's largest state.\": ['sindh', 'rajasthan'],\n",
       " 'Evonne Goolagong Cawley was born on July 31st, 1951.': ['evonne goolagong cawley'],\n",
       " 'Goat Island is connected to only one bridge.': ['goat island  new york '],\n",
       " 'Amazon.com sells media files.': ['amazon com'],\n",
       " 'Yamaha Corporation is a Japanese electronics corporation.': ['yamaha corporation'],\n",
       " 'Qatar is not a movie.': ['qatar'],\n",
       " 'Jennifer Grey was born on the 26th.': ['jennifer grey'],\n",
       " 'In the 1964 United States presidential election, Lyndon B. Johnson defeated Barry Goldwater.': ['lyndon b  johnson'],\n",
       " 'R. Kelly has sold over 100 million records.': ['r  kelly'],\n",
       " 'George Best is European.': ['george best'],\n",
       " 'Here Comes the Sun was recorded at Abbey Road Studios in London in 1969.': ['here comes the sun'],\n",
       " 'Ricky Martin is a modest star in Mexico.': ['ricky martin'],\n",
       " 'Steve Mouzakis refused to play the character Steven Ray.': ['steve mouzakis'],\n",
       " 'Patch Adams (film) is a film that was incapable of starring Monica Potter.': ['patch adams  film '],\n",
       " 'Shirley MacLaine has won a BAFTA for Best Foreign Actress for Ask Any Girl and The Apartment.': ['shirley maclaine'],\n",
       " 'Kirk Douglas acted in Lonely Are the Brave.': ['kirk douglas'],\n",
       " \"Chris Evans' (actor) directorial debut was Before We Go.\": ['chris evans  actor '],\n",
       " 'Gift of the Night Fury stars the voice of an actor whose birthday is on November 13.': ['gift of the night fury',\n",
       "  'gerard butler'],\n",
       " 'Katrina Bowden appeared on 30 Rock.': ['30 rock'],\n",
       " 'David Dhawan is only a film producer.': ['david dhawan'],\n",
       " 'Romelu Lukaku plays in Europe.': ['romelu lukaku',\n",
       "  'belgium national football team'],\n",
       " 'Fairfield Grammar School was called Fairfield Secondary and Higher Grade School when it was founded.': ['fairfield grammar school'],\n",
       " 'Ramona Marquez played the role of Karen Brockman.': ['ramona marquez'],\n",
       " 'The Italian Republic is the proper term for Italy.': ['italy'],\n",
       " 'The 1992 Los Angeles riots occurred in 2000.': ['1992 los angeles riots'],\n",
       " 'Thomas Haden Church is the director of the film Rolling Kansas.': ['thomas haden church'],\n",
       " \"Carol Leifer's comedy career began in the 1980s.\": ['carol leifer'],\n",
       " 'Paul Pogba ended his career in 2011.': ['paul pogba', 'paul pogba'],\n",
       " 'Evil is frequently associated with revenge.': ['evil'],\n",
       " \"Vladimir Putin's birth place is in Russia's second-largest city.\": ['vladimir putin',\n",
       "  'saint petersburg'],\n",
       " 'True Blood is dark fantasy.': ['true blood'],\n",
       " 'Iraq is not in Western Asia.': ['iraq'],\n",
       " 'Elisabeth Sladen semi-retired in the 1980s.': ['elisabeth sladen'],\n",
       " 'Notes on a Scandal was nominated for The Academy Award for Best Adapted Screenplay.': ['notes on a scandal  film '],\n",
       " 'Justified won two awards.': ['justified  tv series '],\n",
       " 'Guardians of the Galaxy was released on a date.': ['guardians of the galaxy  film '],\n",
       " 'The 2017 Open Championship is not a golf championship.': ['2017 open championship'],\n",
       " 'Reddit had a funding round that included American investors.': ['reddit',\n",
       "  'sam altman',\n",
       "  'ron conway',\n",
       "  'marc andreessen',\n",
       "  'snoop dogg',\n",
       "  'jared leto',\n",
       "  'peter thiel'],\n",
       " 'The West Wing contains the Roosevelt Room.': ['west wing'],\n",
       " 'Paul Newman has won something.': ['paul newman'],\n",
       " 'Anne Frank was not born in a city in Germany.': ['anne frank'],\n",
       " 'True Blood is from the United States.': ['true blood'],\n",
       " 'New Orleans is the 6th largest population in the United States.': ['new orleans'],\n",
       " 'Hayden Panettiere is a person.': ['hayden panettiere'],\n",
       " 'Evan Rachel Wood has been featured in Whatever Works.': ['evan rachel wood'],\n",
       " 'The Kingdom of Georgia fell to invasions.': ['kingdom of georgia'],\n",
       " 'Edward Norton has contributed to the writing in films.': ['edward norton'],\n",
       " \"Miss Peregrine's Home for Peculiar Children had an editor.\": ['miss peregrine s home for peculiar children'],\n",
       " 'The Big Trail was released in 1930.': ['the big trail'],\n",
       " 'Hawaii is not densely populated.': ['hawaii'],\n",
       " 'Helios is the male spawn of Titans.': ['helios'],\n",
       " 'Ubisoft is the name the company Ubisoft Entertainment SA is doing business as.': ['ubisoft'],\n",
       " 'Blizzard Entertainment made the Diablo video game series.': ['blizzard entertainment',\n",
       "  'diablo  series '],\n",
       " 'Cher has won a special CFDA Fashion Award.': ['cher'],\n",
       " 'Break on Me was released through a record label.': ['break on me',\n",
       "  'capitol records nashville',\n",
       "  'break on me',\n",
       "  'capitol records nashville'],\n",
       " 'Bad Boys II has Gabrielle Union in it.': ['gabrielle union'],\n",
       " 'Luke Evans acted the part of Gaston in Beauty and the Beast.': ['luke evans  actor '],\n",
       " 'Jacki Weaver refused to work on Alvin Purple.': ['jacki weaver'],\n",
       " 'Rock music avoids incorporating music genres like folk.': ['rock music'],\n",
       " 'Freddie Mercury is no longer living.': ['freddie mercury'],\n",
       " 'The OA did not premiere on December 16, 2016.': ['the oa'],\n",
       " 'Man of Steel (film) starred Michael Shannon.': ['man of steel  film '],\n",
       " 'Devdas was unable to be screened at the 2002 Cannes Film Festival.': ['devdas  2002 hindi film '],\n",
       " 'Jon Pertwee was in a series from 1987 to 1989.': ['jon pertwee'],\n",
       " 'Inside Man is a movie.': ['inside man'],\n",
       " 'Evan Rachel Wood acted in Once and Again.': ['evan rachel wood'],\n",
       " \"Constantine's screenplay only writer was Christopher Nolan.\": ['constantine  film '],\n",
       " 'Brock Lesnar fought a South Korean person.': ['brock lesnar',\n",
       "  'kim min soo  judoka '],\n",
       " 'Harold Ramis directed.': ['harold ramis'],\n",
       " 'Lewis Hamilton has multiple F1 titles.': ['lewis hamilton',\n",
       "  '2015 formula one season',\n",
       "  '2014 formula one season'],\n",
       " 'Slovakia is a nation.': ['slovakia', 'landlocked country'],\n",
       " 'Jared Kushner is a North American.': ['jared kushner'],\n",
       " 'Prison Break was originally planned for a multiple-episode run.': ['prison break'],\n",
       " 'Splatoon 2 is not developed by Nintendo.': ['splatoon 2'],\n",
       " 'Cate Blanchett won multiple acting Oscars.': ['cate blanchett'],\n",
       " 'The largest urban area of Australia is the most populous city in Australia and Oceania.': ['australia',\n",
       "  'sydney'],\n",
       " 'Adam Sandler was the only person ever to voice act in Hotel Transylvania 2.': ['hotel transylvania 2'],\n",
       " 'The Promise was released in the United States in 2017.': ['the promise  2016 film '],\n",
       " 'How to Train Your Dragon (film) failed to win the Academy Award for Best Original Score at the 83rd Academy Awards.': ['how to train your dragon  film '],\n",
       " \"James Taylor's Greatest Hits album sold 12 million US copies.\": ['james taylor'],\n",
       " \"Vlad the Impaler's male sibling is called Mircea.\": ['vlad the impaler'],\n",
       " 'One Direction won awards.': ['one direction'],\n",
       " 'Wild Ones is by Flo Rida.': ['wild ones  song '],\n",
       " 'Transformers: The Last Knight stars Josh Duhamel.': ['transformers colon  the last knight'],\n",
       " 'Josh Duhamel is employed by the film industry.': ['josh duhamel'],\n",
       " 'Funny or Die is a production company.': ['funny or die'],\n",
       " 'Bill Gates was born in 1978.': ['bill gates'],\n",
       " 'Morena Baccarin received an award nomination.': ['morena baccarin'],\n",
       " 'Marlon Brando has been awarded at least two Academy Awards.': ['marlon brando'],\n",
       " 'Inside Man is a motion picture.': ['inside man'],\n",
       " 'Glenn Frey has only ever worked with Don Henley.': ['glenn frey',\n",
       "  'eagles  band '],\n",
       " 'Sons of Anarchy is not about a motorcycle club.': ['sons of anarchy'],\n",
       " 'Starbucks annually launches their Pumpkin Spice Latte in the fall.': ['starbucks'],\n",
       " 'Carrie Fisher wrote an autobiography.': ['carrie fisher',\n",
       "  'wishful drinking'],\n",
       " 'Rockefeller University is in a state.': ['new york',\n",
       "  'rockefeller university'],\n",
       " 'Walt Whitman volunteered during the American Civil War in 1933.': ['walt whitman'],\n",
       " 'Martin Freeman is an English actor.': ['martin freeman'],\n",
       " 'Canada was a British colony in South America.': ['canada'],\n",
       " 'Dogstar (band) performed at the Glastonbury Festival.': ['dogstar  band '],\n",
       " 'Yelp existed in the 21st century.': ['yelp'],\n",
       " 'Game of Thrones is a television show.': ['game of thrones'],\n",
       " 'John Wayne Gacy buried 26 victims and was later caught.': ['john wayne gacy'],\n",
       " 'A Golden Globe was given to Jason Bateman.': ['jason bateman'],\n",
       " 'Charles, Prince of Wales has not sought to raise world awareness of the dangers facing the natural environment, such as climate change.': ['charles  prince of wales'],\n",
       " \"Robert Wagner and Scott Eyman wrote Wagner's autobiography.\": ['robert wagner'],\n",
       " 'The Bends was released by UPS.': ['the bends'],\n",
       " 'In & Out is an Indian film.': ['in   out  film '],\n",
       " 'Neymar is Brazilian.': ['neymar'],\n",
       " 'The Beastie Boys had at least five studio albums.': ['beastie boys'],\n",
       " 'The terrain of Kazakhstan includes rock canyons.': ['kazakhstan'],\n",
       " 'Kajal Aggarwal has an acting career.': ['kajal aggarwal'],\n",
       " 'Will Ferrell wrote Step Brothers with Adam McKay.': ['will ferrell',\n",
       "  'the other guys'],\n",
       " 'Meryl Streep began acting professionally in 1980.': ['meryl streep'],\n",
       " \"Judd Apatow's films have received a nomination for a Tony Award.\": ['judd apatow',\n",
       "  'tony award'],\n",
       " 'Drax the Destroyer was created.': ['drax the destroyer'],\n",
       " 'Cedric Yarbrough has been in a television show.': ['cedric yarbrough'],\n",
       " 'Vikram is an Indian actor.': ['vikram  actor '],\n",
       " 'Lynyrd Skynyrd permanently disbanded after the death of its first lead vocalist.': ['lynyrd skynyrd'],\n",
       " 'Harry Potter was written by an Icelandic author.': ['harry potter',\n",
       "  'j  k  rowling'],\n",
       " 'Hitler was never appointed as Chancellor of Germany.': ['adolf hitler'],\n",
       " 'Michael Jackson was killed via a particular type of homicide.': ['michael jackson',\n",
       "  'manslaughter'],\n",
       " 'Law of value appeared first in a book called death.': ['law of value'],\n",
       " 'Karl Malone has always been incapable of playing basketball.': ['karl malone',\n",
       "  'power forward  basketball '],\n",
       " 'Elephants have been highlighted in religion.': ['elephant'],\n",
       " \"The Invention of Lying's cast includes Jennifer Garner.\": ['the invention of lying'],\n",
       " 'John Bradley-West is a Japanese actor.': ['john bradley west'],\n",
       " 'Tina Turner put out a solo album.': ['tina turner'],\n",
       " 'Resident Evil is about zombie outbreaks caused by the T-Virus.': ['resident evil'],\n",
       " 'There is a province called Newfoundland and Labrador.': ['newfoundland and labrador'],\n",
       " 'War Dogs features Ana de Armas.': ['war dogs  2016 film '],\n",
       " 'Las Vegas is the largest city within Utah.': ['las vegas'],\n",
       " 'Mother Teresa lived in Macedonia for eighteen years.': ['mother teresa'],\n",
       " \"Franklin D. Roosevelt's strategy barely ended in the defeat of the Axis Powers.\": ['franklin d  roosevelt'],\n",
       " 'Michelangelo did sculptures.': ['michelangelo'],\n",
       " 'The Craft is a 1996 novel.': ['the craft  film '],\n",
       " 'Sarah Paulson portrayed Harriet Hayes.': ['sarah paulson'],\n",
       " 'On May 17, 1970, Jordan Knight was born.': ['jordan knight'],\n",
       " 'South America is home to the Amazon River, the largest river in the world.': ['south america',\n",
       "  'amazon river'],\n",
       " 'Poppy (singer) is also known as \"That Poppy.\"': ['poppy  singer '],\n",
       " \"Take a Bow is the second single off of Madonna's sixth album.\": ['take a bow  madonna song '],\n",
       " 'Ice hockey has only domestic competitions.': ['ice hockey'],\n",
       " 'The Santos FC is a Brazil sports club.': ['santos fc'],\n",
       " \"Red Headed Stranger's lyrics have been featured in the comic Preacher.\": ['red headed stranger'],\n",
       " \"Islam didn't have a prophet named Muhammad.\": ['islam',\n",
       "  'khatam an nabiyyin',\n",
       "  'muhammad'],\n",
       " 'Fred Trump was thirteen years old in December, 1918.': ['fred trump',\n",
       "  'frederick trump'],\n",
       " 'The Godfather Part III was nominated for an award for Most Valuable Player.': ['the godfather part iii',\n",
       "  'most valuable player'],\n",
       " 'Dragon is related to something.': ['dragon'],\n",
       " \"The Dark Knight Rises' filming took place in New Jersey.\": ['the dark knight rises',\n",
       "  'newark  new jersey'],\n",
       " 'Charlize Theron acted in a film directed by Guillermo Arriaga.': ['charlize theron',\n",
       "  'the burning plain'],\n",
       " 'Denial premiered at the Sundance Film Festival.': ['denial  2016 film '],\n",
       " 'Amsterdam Airport Schiphol serves as a European hub for Jet Airways.': ['amsterdam airport schiphol'],\n",
       " 'Drama school offers zero degrees.': ['drama school',\n",
       "  'drama school',\n",
       "  'drama school'],\n",
       " 'Maya Rudolph appeared in the film Grown Ups.': ['maya rudolph'],\n",
       " 'Radioactive received an honor from The Recording Academy.': ['radioactive  imagine dragons song ',\n",
       "  'grammy award'],\n",
       " 'George Best scored zero goals.': ['george best'],\n",
       " 'Tré Cool is a physician, plumber, and garbage man.': ['tré cool'],\n",
       " 'Tyrese Gibson is famous for his part in the Transformers film series.': ['tyrese gibson'],\n",
       " \"The Dark Knight was released six months after Ledger's death.\": ['the dark knight  film '],\n",
       " 'Eddie Vedder has done solo music work.': ['eddie vedder'],\n",
       " 'The Divergent Series: Allegiant fails to be based on a work by Veronica Roth.': ['the divergent series colon  allegiant'],\n",
       " 'O. J. Simpson was arrested in 2009.': ['o  j  simpson'],\n",
       " 'The Wars of the Roses occurred in England.': ['wars of the roses'],\n",
       " '2017 was the year when The Fate of the Furious was premiered.': ['the fate of the furious'],\n",
       " 'Saswata Chatterjee works as a film actor.': ['saswata chatterjee'],\n",
       " 'Following was directed by Christopher Nolan.': ['following'],\n",
       " 'The Council on Foreign Relations was founded in America.': ['council on foreign relations'],\n",
       " 'K2 is 8611 centimeters above sea level.': ['k2'],\n",
       " 'Jon Pertwee took part in Worzel Gummidge.': ['jon pertwee'],\n",
       " 'The subject of The Prestige is stage magic.': ['the prestige  film '],\n",
       " 'Carbon has 6 as its atomic number.': ['carbon'],\n",
       " 'John Stewart was the first African American superhero to be featured in a film.': ['john stewart  comics '],\n",
       " 'The World Science Festival is unaffiliated with the World Science Foundation.': ['world science festival'],\n",
       " 'The phalanx appears in Greek texts.': ['phalanx'],\n",
       " \"Natalie Wood's birthday is May 20.\": ['natalie wood'],\n",
       " 'Eddie Redmayne is a person.': ['eddie redmayne'],\n",
       " 'Alicia Silverstone played Batgirl.': ['alicia silverstone'],\n",
       " 'The Void is a motion picture.': ['the void  2016 film '],\n",
       " 'The Bulls were in the 1991 NBA Finals.': ['1991 nba finals'],\n",
       " 'Gary Ridgway worked in Washington.': ['gary ridgway'],\n",
       " 'Adam West was born in 1923.': ['adam west'],\n",
       " \"Dr. Dre's solo album is called 2001.\": ['dr  dre'],\n",
       " 'Freddie Mercury received an award.': ['freddie mercury'],\n",
       " 'Tyrion Lannister is portrayed by an actor.': ['tyrion lannister'],\n",
       " 'Gil Sharone began working with an American rock band.': ['gil sharone',\n",
       "  'marilyn manson  band '],\n",
       " 'Houston has a population from various ethnic and racial backgrounds.': ['houston'],\n",
       " \"Tanzania's former capital city and principal port is Dar es Salaam.\": ['tanzania'],\n",
       " 'Humanz includes collaborative piece done with Pusha T.': ['humanz'],\n",
       " 'The Dodecanese belong to Greece.': ['dodecanese', 'southern sporades'],\n",
       " 'Precious premiered to acclaim at the 2009 Cannes Film Festival.': ['precious  film '],\n",
       " 'Boromir appears in The Fellowship of the Panther God.': ['boromir'],\n",
       " 'Slipknot is a solo musician.': ['slipknot  band '],\n",
       " 'Rhode Island renounced its allegiance to the British Crown.': ['rhode island'],\n",
       " 'Dan Aykroyd was in an American comedy-drama film from 1989.': ['dan aykroyd',\n",
       "  'driving miss daisy'],\n",
       " 'Michelle Obama is married to Barack Obama.': ['michelle obama',\n",
       "  'michelle obama'],\n",
       " \"Selena Gomez's album is called Revival.\": ['selena gomez'],\n",
       " 'Zooey Deschanel is from America.': ['zooey deschanel'],\n",
       " 'Mike Tyson was disqualified.': ['mike tyson'],\n",
       " \"Miss Peregrine's Home for Peculiar Children is only a German film.\": ['miss peregrine s home for peculiar children  film '],\n",
       " 'Rio de Janeiro is not in the Americas.': ['rio de janeiro'],\n",
       " \"The Eagles' guitarist is Joe Walsh who joined in 1975.\": ['eagles  band '],\n",
       " 'Adrienne Bailon is practiced in music.': ['adrienne bailon'],\n",
       " \"The World Science Festival's producer is the World Science Foundation.\": ['world science festival'],\n",
       " 'Quentin Tarantino directed Kill Bill: Volume 2.': ['kill bill colon  volume 2'],\n",
       " 'Lilith translates to \"night monster.\"': ['lilith', 'lilith'],\n",
       " 'Ellyse Perry played baseball at the age of 16.': ['ellyse perry'],\n",
       " \"Nina Simone's hometown is in North Carolina.\": ['nina simone'],\n",
       " \"Turn: Washington's Spies was renewed for a third 10-episode season.\": ['turn colon  washington s spies',\n",
       "  'turn colon  washington s spies'],\n",
       " 'Cleopatra (1963 film) is an American comedy film.': ['cleopatra  1963 film '],\n",
       " \"Helen Keller did not campaign for women's suffrage.\": ['helen keller'],\n",
       " 'Linda McCartney was diagnosed with breast cancer in 1995.': ['linda mccartney'],\n",
       " 'John Glenn was the first American astronaut to orbit the Earth.': ['john glenn'],\n",
       " 'The Sopranos was first broadcast on A&E in 2011.': ['the sopranos'],\n",
       " 'Steve Coogan is incapable of acting.': ['steve coogan'],\n",
       " 'The Bostonians (film) is a 1984 film.': ['the bostonians  film '],\n",
       " 'Ethiopia is in the peninsula the Horn of Africa.': ['ethiopia',\n",
       "  'horn of africa'],\n",
       " 'Quinoa is a common name for a plant.': ['quinoa'],\n",
       " 'American Gods is an American television series.': ['american gods  tv series '],\n",
       " 'Alpha House is inspired by nobody.': ['alpha house',\n",
       "  'alpha house',\n",
       "  'alpha house',\n",
       "  'alpha house'],\n",
       " \"Rumi's art is widely read.\": ['rumi'],\n",
       " 'Thirteen was directed by Catherine Hardwicke in 2001.': ['thirteen  2003 film '],\n",
       " 'Arrow is a TV series on the CW.': ['arrow  tv series '],\n",
       " 'Warren G. Harding died in 1865.': ['warren g  harding'],\n",
       " 'Arnold Schwarzenegger was involved with work by a Canadian filmmaker, director, producer, screenwriter, inventor, engineer, philanthropist, and deep-sea explorer name James Cameron.': ['arnold schwarzenegger',\n",
       "  'james cameron'],\n",
       " 'There are only 300 members total in US Congress.': ['united states congress'],\n",
       " 'Kathy Bates rose to prominence with her performance in Misery in 2005.': ['kathy bates'],\n",
       " 'One game sequel is Super Metroid.': ['super metroid'],\n",
       " 'The Flash was written by Danny Bilson and Paul De Meo.': ['the flash  1990 tv series '],\n",
       " 'The Crown (TV series) starred Steve Martin.': ['the crown  tv series '],\n",
       " 'Ariana Grande had one album prior to her album My Everything.': ['ariana grande'],\n",
       " 'The Belko Experiment was not written by James Gunn.': ['the belko experiment'],\n",
       " 'Sierra Leone became an independent nation on April 27 1961.': ['sierra leone'],\n",
       " 'Matthew Weiner created Mad Men.': ['mad men'],\n",
       " 'Portia de Rossi starred as Olivia Lord.': ['portia de rossi'],\n",
       " 'Ivan Lendl is a tennis pebble.': ['ivan lendl'],\n",
       " 'Sunrise created anime from 1979 to 2008.': ['sunrise  company ',\n",
       "  'gundam',\n",
       "  'inuyasha'],\n",
       " 'Cambodia have minority groups like Chinese.': ['cambodia'],\n",
       " \"Grace Jones's style was influenced by funk.\": ['grace jones'],\n",
       " \"Tall Story's director was born in the 1900's.\": ['tall story'],\n",
       " 'The Harry Potter series has been translated into many languages.': ['harry potter'],\n",
       " 'Earl Warren worked as a governor.': ['earl warren'],\n",
       " 'Dexter features the character Lumen Pierce.': ['lumen pierce'],\n",
       " 'Aruba has a climate.': ['aruba'],\n",
       " 'Marlon Brando was included in a list.': ['marlon brando'],\n",
       " 'Courteney Cox appeared on a sitcom.': ['courteney cox'],\n",
       " 'The Mughal Empire was ruled by a dynasty.': ['mughal empire'],\n",
       " 'Me Before You is a romantic drama film released in 2017.': ['me before you  film '],\n",
       " 'X-Men: Days of Future Past came out in 2016.': ['x men colon  days of future past'],\n",
       " 'Dolly Parton starred in the comedy 9 to 5.': ['dolly parton'],\n",
       " 'BYD Auto is a manufacturer from China.': ['byd auto'],\n",
       " 'Thomas Pynchon published several short stories.': ['thomas pynchon'],\n",
       " 'Robin Thicke has worked with a mononymous singer.': ['robin thicke',\n",
       "  'brandy norwood',\n",
       "  'usher  musician '],\n",
       " 'Penny Dreadful aired on HBO.': ['penny dreadful  tv series '],\n",
       " 'Jon Huntsman Jr. served as United States Ambassador to Singapore from 1992 to 1993.': ['jon huntsman jr '],\n",
       " \"Matt Smith's last television role was as Jim Taylor.\": ['matt smith  actor '],\n",
       " 'The Ultimates has been worked on by Mark Millar.': ['mark millar'],\n",
       " 'Pacific Rim received generally positive reviews.': ['pacific rim  film '],\n",
       " 'Tiger Woods plays sports professionally.': ['tiger woods'],\n",
       " 'Cape Fear stars an actor.': ['cape fear  1991 film ',\n",
       "  'gregory peck',\n",
       "  'cape fear  1991 film ',\n",
       "  'cape fear  1991 film ',\n",
       "  'robert de niro',\n",
       "  'cape fear  1991 film ',\n",
       "  'gregory peck'],\n",
       " \"Kitti's hog-nosed bat is the only extant member of a family.\": ['kitti s hog nosed bat'],\n",
       " \"Arkham Asylum's patients are comprised of the Riddler.\": ['arkham asylum'],\n",
       " 'Audrey Horne was introduced in a series that premiered in 1990.': ['audrey horne',\n",
       "  'twin peaks'],\n",
       " 'Paul Newman was an IndyCar driver.': ['paul newman',\n",
       "  'paul newman',\n",
       "  'paul newman'],\n",
       " 'Pablo Fenjves wrote for someone who wrote.': ['pablo fenjves',\n",
       "  'ghostwriter'],\n",
       " 'Mel Gibson played a lead role in a movie.': ['mel gibson',\n",
       "  'mad max  franchise '],\n",
       " 'There was a period of peace that the country of Lebanon experienced.': ['lebanon'],\n",
       " 'The Martian was directed by Adam Sandler.': ['the martian  film '],\n",
       " 'Andrew Stanton has worked on movies.': ['andrew stanton'],\n",
       " 'Joseph Stalin was made General Secretary in 1922.': ['joseph stalin'],\n",
       " 'Jared Leto was born December 26, 1971.': ['jared leto'],\n",
       " 'Event management is the application of project management.': ['event management',\n",
       "  'event management'],\n",
       " 'Kris Jenner is the aunt of Kourtney Kardashian.': ['kris jenner'],\n",
       " 'Over 75% of the Russian population live in European Russia.': ['russia'],\n",
       " 'James Bond is portrayed by Daniel Craig in the film Spectre.': ['james bond'],\n",
       " 'Me Before You is set in the UK.': ['me before you  film '],\n",
       " 'The Wonderful Wizard of Oz is where the Wicked Witch of the West made her debut.': ['wicked witch of the west'],\n",
       " 'Rope is a film.': ['rope  film ', 'rope  film '],\n",
       " 'Octopuses protect themselves against predators.': ['octopus'],\n",
       " 'Bulgaria saw conflicts with its neighbours.': ['bulgaria'],\n",
       " 'The Bridges of Madison County (film) was destroyed before it can be released.': ['the bridges of madison county  film '],\n",
       " 'John is the middle name of Donald Trump.': ['donald trump'],\n",
       " 'Neve Campbell had a starring role in seasons of House of Cards.': ['neve campbell'],\n",
       " 'Jesse Eisenberg starred in a film directed by Greg Mottola in 2009.': ['jesse eisenberg',\n",
       "  'adventureland  film '],\n",
       " 'Baahubali: The Beginning is a movie from India released in 2015.': ['baahubali colon  the beginning'],\n",
       " 'The Americans first aired on FX.': ['the americans  2013 tv series '],\n",
       " 'Mariah Carey is from America.': ['mariah carey'],\n",
       " 'Shahid Kapoor has only starred in Jumanji.': ['shahid kapoor'],\n",
       " 'Interstellar is an American science-fiction movie.': ['interstellar  film '],\n",
       " \"James Nesbitt was a star in Murphy's Law from 2001-2007.\": ['james nesbitt'],\n",
       " 'Portia de Rossi won a Screen Actors Guild Award in 1999 for her role in Ally McBeal.': ['portia de rossi'],\n",
       " 'Ramzan Kadyrov established a tournament.': ['ramzan kadyrov'],\n",
       " 'Asia extends to places.': ['asia'],\n",
       " 'Agatha Christie was given the status of Dame for her literary contributions.': ['agatha christie'],\n",
       " 'Martin Scorsese worked on the pilot episode of Boardwalk Empire.': ['martin scorsese'],\n",
       " 'The Conjuring 2 was released in 2016.': ['the conjuring 2'],\n",
       " 'Elizabeth Meriwether is a television antenna.': ['elizabeth meriwether'],\n",
       " 'The Minnesota Vikings have lost all their Super Bowl games.': ['minnesota vikings'],\n",
       " 'Iron Man is based on the eponymous superhero.': ['iron man  2008 film '],\n",
       " 'The Thénardiers are in Les Miserables.': ['thénardiers'],\n",
       " 'Jay Sekulow is a lawyer.': ['jay sekulow',\n",
       "  'lawyer',\n",
       "  'jay sekulow',\n",
       "  'lawyer'],\n",
       " 'Keanu Reeves is a car.': ['keanu reeves'],\n",
       " 'Tom Felton did not act in From the Rough.': ['tom felton'],\n",
       " 'The Hermetic Order of the Golden Dawn was focused on the study of the occult.': ['hermetic order of the golden dawn'],\n",
       " 'Greece is a Jewish state.': ['christian state'],\n",
       " 'Mike Pence lost a US congressional election in 1988.': ['mike pence'],\n",
       " 'There is an album called Honeysuckle Rose by Willie Nelson.': ['willie nelson',\n",
       "  'honeysuckle rose  album '],\n",
       " 'Rio de Janeiro is in Brazil.': ['rio de janeiro'],\n",
       " 'John Cena has a career in a organization.': ['john cena', 'wwe'],\n",
       " \"The blue whale's body can be various shades of bluish-grey dorsally, and somewhat lighter underneath.\": ['blue whale'],\n",
       " 'Saving Private Ryan is a portrayal of war.': ['saving private ryan'],\n",
       " 'Titanium was written by David Guetta and a team of uncredited writers.': ['titanium  song '],\n",
       " 'Kevin Durant is not a photographer.': ['kevin durant'],\n",
       " 'Fargo has executive producers.': ['fargo  tv series '],\n",
       " 'Bridget Moynahan tried to have a career in modeling.': ['bridget moynahan'],\n",
       " 'Bill Gates is the co-founder of Microsoft.': ['bill gates'],\n",
       " \"Role Models stars American actor Bobb'e J. Thompson.\": ['role models',\n",
       "  'bobb e j  thompson'],\n",
       " 'Tom Hiddleston appeared in War Horse.': ['tom hiddleston',\n",
       "  'tom hiddleston',\n",
       "  'tom hiddleston',\n",
       "  'tom hiddleston'],\n",
       " 'James Garner played the leading male role in The Great Escape.': ['james garner'],\n",
       " 'LGBT is not an acronym containing the word transgender.': ['lgbt'],\n",
       " 'Lily Collins wrote the book Clary Fray.': ['lily collins'],\n",
       " 'Leyton Orient F.C. is in the ocean.': ['leyton orient f c '],\n",
       " 'George Foreman has been inducted into the World Boxing Hall of Fame.': ['george foreman',\n",
       "  'george foreman',\n",
       "  'george foreman'],\n",
       " 'Lily Collins attended University of Southern California.': ['lily collins'],\n",
       " 'South America is home to the Charles River.': ['south america',\n",
       "  'charles river'],\n",
       " 'Pregnancy can occur as a result of assisted reproductive technology.': ['pregnancy'],\n",
       " 'The Night Of was co-directed by James Marsh.': ['the night of'],\n",
       " 'Avatar was unconnected to James Cameron.': ['avatar  2009 film '],\n",
       " 'Minnesota was inhabited by native peoples of Canada and the northern United States.': ['minnesota',\n",
       "  'anishinaabe'],\n",
       " 'Maigret stars Rowan Atkinson.': ['rowan atkinson'],\n",
       " \"The Kitti's hog-nosed bat is capable of movement.\": ['kitti s hog nosed bat'],\n",
       " 'Alice is a movie.': ['alice  1990 film '],\n",
       " \"Kaitlin Olson was a cast on It's Always Sunny in Philadelphia in 2005.\": ['kaitlin olson'],\n",
       " 'Maggie Smith is an actress.': ['maggie smith'],\n",
       " 'American Gothic television show had an appearance from Evan Rachel Wood.': ['evan rachel wood'],\n",
       " 'William Shatner hosted a television series.': ['william shatner'],\n",
       " 'Barbados is not ranked as a leading tourist destination.': ['barbados'],\n",
       " 'Keanu Reeves has only worked as a chef.': ['keanu reeves'],\n",
       " 'Sean Combs was born in Harlem.': ['sean combs'],\n",
       " 'The Fisher King features Michael Jeter in a supporting role.': ['the fisher king'],\n",
       " 'Varun Dhawan has worked with people.': ['varun dhawan'],\n",
       " 'Cary Grant co-directed in the film The Philadelphia Story.': ['cary grant',\n",
       "  'the philadelphia story  film '],\n",
       " 'Muhammad was persecuted by some Meccan tribes.': ['muhammad',\n",
       "  'persecution of muslims by meccans'],\n",
       " 'Harry Styles has yet to ever act.': ['harry styles'],\n",
       " 'The Houston Rockets have won four Western Conference sandwiches.': ['houston rockets'],\n",
       " 'Nick Nolte was born in 1943.': ['nick nolte'],\n",
       " 'Stagira is an ancient city.': ['stagira  ancient city ',\n",
       "  'stagira  ancient city '],\n",
       " 'Tim Rice wrote Chess with Bjorn Ulvaeus.': ['tim rice'],\n",
       " 'Liev Schreiber became known.': ['liev schreiber'],\n",
       " 'Timon & Pumbaa is made by a company.': ['timon   pumbaa  tv series '],\n",
       " 'Glen Campbell is from America.': ['glen campbell'],\n",
       " 'Eddie Redmayne has always declined to act in spy films.': ['eddie redmayne',\n",
       "  'the good shepherd  film '],\n",
       " 'The Voice is a university class.': ['the voice  u s  tv series '],\n",
       " 'Neve Campbell has yet to work with Netflix.': ['neve campbell'],\n",
       " 'Good Will Hunting cast included Matt Damon.': ['good will hunting'],\n",
       " 'George H. W. Bush was president from 1889 to 1993.': ['george h  w  bush'],\n",
       " 'Chris Froome finished the 2011 Vuelta a España.': ['chris froome'],\n",
       " 'Taraji P. Henson starred in a movie.': ['taraji p  henson', 'hustle   flow'],\n",
       " 'Michelle Rodriguez is in the film industry.': ['michelle rodriguez'],\n",
       " 'Philadelphia contains 67 National Historic Landmarks.': ['philadelphia'],\n",
       " 'The Nilotic languages have speakers in South Sudan.': ['nilotic languages'],\n",
       " 'Yardie was published in 2001.': ['yardie  novel '],\n",
       " 'Ranbir Kapoor is the co-founder of a production company.': ['ranbir kapoor'],\n",
       " 'Sister Act is a TV show.': ['sister act'],\n",
       " 'Raoul Walsh directed The Big Trail.': ['the big trail'],\n",
       " 'Ringo Starr sang lead vocals on \"Yellow Submarine\".': ['ringo starr'],\n",
       " 'The Wolf of Wall Street got multiple nominations at the Academy Awards in 2014.': ['the wolf of wall street  2013 film ',\n",
       "  '86th academy awards'],\n",
       " 'Anastasia Steele is a main character in Fifty Shade of Grey.': ['fifty shades of grey'],\n",
       " 'Good Will Hunting stars Ben Affleck.': ['good will hunting'],\n",
       " 'The Resident Evil film series is loosely inspired by the game of the same name.': ['resident evil  film series '],\n",
       " 'Christopher Columbus worked for monarchs.': ['christopher columbus'],\n",
       " 'Jesse Eisenberg was employed with Ari Graynor.': ['jesse eisenberg',\n",
       "  'holy rollers  film '],\n",
       " 'Game of Thrones is a board game.': ['game of thrones'],\n",
       " 'Nicki Minaj grew up in the UK.': ['nicki minaj'],\n",
       " 'Mark Cuban is a person who invests.': ['mark cuban'],\n",
       " 'Sunrise created a co-production with a design studio formed in 1972 and it is Japanese.': ['sunrise  company ',\n",
       "  'studio nue'],\n",
       " 'Sepsis is more common among males than females as of 1988.': ['sepsis'],\n",
       " 'Dementia was an ailment of Al Capone.': ['al capone'],\n",
       " 'The Great Buck Howard is rarely American.': ['the great buck howard'],\n",
       " 'Bradley Cooper found great success with a black comedy crime film.': ['bradley cooper'],\n",
       " 'The United States is a superpower.': ['united states'],\n",
       " 'Lisbon is a city that is the capital of something.': ['lisbon'],\n",
       " 'Sylvester Stallone was nominated twice for the Academy Awards in 1977 for Rocky.': ['sylvester stallone'],\n",
       " 'Ryan Gosling earned a Golden Globe nomination for his role in Blue Valentine.': ['ryan gosling'],\n",
       " 'Vikram runs a welfare association.': ['vikram  actor '],\n",
       " 'Travis Barker has avoided drums completely.': ['travis barker'],\n",
       " 'David Beckham signed a contract with LA Galaxy.': ['david beckham',\n",
       "  'la galaxy'],\n",
       " 'Titus destroyed a city.': ['titus'],\n",
       " 'Jean-Claude Van Damme is a Belgian screenwriter.': ['jean claude van damme'],\n",
       " 'Anthony Meindl has worked with and coached Chace Crawford.': ['anthony meindl'],\n",
       " 'The Hangover Part III includes Ed Helms.': ['the hangover part iii'],\n",
       " \"Above the Law's alternative title is Nico.\": ['above the law  film '],\n",
       " 'Tale of Tales is a film from 2015.': ['tale of tales  2015 film '],\n",
       " 'Buddhism is largely based on the lessons of Buddha.': ['buddhism'],\n",
       " 'Edward Norton has co-written on projects.': ['edward norton'],\n",
       " 'Emmanuel Adebayor died in the Togo national football team attack.': ['emmanuel adebayor'],\n",
       " 'The Council on Foreign Relations is a for-profit.': ['council on foreign relations',\n",
       "  'council on foreign relations'],\n",
       " 'Glee was nominated for Outstanding Original Music and Lyrics.': ['glee  season 6 '],\n",
       " 'Hugh Grant was a figure of 1990s British popular culture.': ['hugh grant'],\n",
       " 'Cougar Town was an American television sitcom that ended in 2016.': ['cougar town'],\n",
       " 'Joy was directed by David O. Russell.': ['joy  film '],\n",
       " 'George Martin refused to ever work in television.': ['george martin'],\n",
       " 'Bal Gangadhar Tilak died on August 1, 1820.': ['bal gangadhar tilak'],\n",
       " 'Detroit is the 21st-most populous city in the United States.': ['detroit'],\n",
       " 'Charlie Rubin did some writing for In Living Color.': ['charlie rubin'],\n",
       " 'London was at first a settlement named Londinium in the year 43.': ['london',\n",
       "  'londinium'],\n",
       " 'Saskatchewan is bordered on the east by a western province of Canada.': ['saskatchewan',\n",
       "  'manitoba'],\n",
       " 'Christianity extended to sub-Saharan Africa.': ['christianity'],\n",
       " 'The Great Debaters is a television show.': ['the great debaters'],\n",
       " 'Lust for Life was adapted only by Martin Scorsese.': ['lust for life  film '],\n",
       " 'There is a sport called tennis.': ['tennis'],\n",
       " 'Leonardo da Vinci has only ever been in Venice.': ['leonardo da vinci'],\n",
       " 'Ginger Baker was almost inducted into the Classic Drummer Hall of Fame.': ['ginger baker'],\n",
       " 'Juris Doctor is earned by completing law school in some common law countries.': ['juris doctor'],\n",
       " 'Hopman Cup has been attended by nobody.': ['hopman cup'],\n",
       " 'Indian is a comedy drama podcast.': ['indian  1996 film '],\n",
       " 'Laurence Olivier starred in an adaptation of Hamlet.': ['laurence olivier',\n",
       "  'hamlet  1948 film '],\n",
       " 'Dubai is located on the north coast of a sea in Eastern Asia.': ['dubai'],\n",
       " 'Jerry Seinfeld is only a comedian.': ['jerry seinfeld'],\n",
       " 'Jean-Martin Charcot was a neurologist.': ['jean martin charcot'],\n",
       " 'Steven Soderbergh directed something.': ['steven soderbergh'],\n",
       " 'Sanjay Gupta was rejected from the White House Fellows program.': ['sanjay gupta'],\n",
       " 'Bring It On (film) is a television show.': ['bring it on  film '],\n",
       " 'Hannibal was a military strategist.': ['hannibal'],\n",
       " 'Cage Warriors held an event in the most populous city of England.': ['cage warriors',\n",
       "  'london'],\n",
       " 'Bill Gates was chief software architect at Microsoft.': ['bill gates'],\n",
       " 'Michael Jackson was killed by Conrad Murray.': ['michael jackson'],\n",
       " 'Ellen Burstyn has yet to win any Emmy Awards.': ['ellen burstyn'],\n",
       " 'Atlantic City failed to cast Kate Reid.': ['atlantic city  1980 film '],\n",
       " 'Kurt Angle is not an American professional wrestler.': ['kurt angle'],\n",
       " \"Jennifer Aniston's net worth as of 2014 is estimated at 150 million.\": ['jennifer aniston'],\n",
       " 'Dolly Parton starred in Rhinestone.': ['dolly parton'],\n",
       " 'Calvin Harris has more songs on the UK Singles Chart than Michael Jackson.': ['calvin harris'],\n",
       " 'Gayathri Raguram started out in a film.': ['gayathri raguram'],\n",
       " 'The Godfather Part III only stars male actors.': ['the godfather part iii',\n",
       "  'diane keaton'],\n",
       " 'Tom Hardy has appeared in three Christopher Nolan works.': ['tom hardy'],\n",
       " 'Michael Jackson was accused of child sexual abuse.': ['michael jackson'],\n",
       " 'The Hui people also have communities other regions of China.': ['hui people'],\n",
       " 'Sarrainodu translates to \"The Wrong Person\".': ['sarrainodu'],\n",
       " 'Ajab Prem Ki Ghazab Kahani is a film from India.': ['ajab prem ki ghazab kahani'],\n",
       " 'Kirk Douglas was born two years before December 9th, 1916.': ['kirk douglas'],\n",
       " 'Ryan Dusick is an American musician and producer.': ['ryan dusick'],\n",
       " 'Seven Days in May passed over Ava Gardner for a role in the cast.': ['seven days in may'],\n",
       " 'Love & Mercy (film) was unable to cast John Cusack.': ['love   mercy  film '],\n",
       " 'There is a band called Blink-182.': ['blink 182'],\n",
       " 'Adam Sandler is an actor.': ['adam sandler'],\n",
       " 'Papua New Guinea is dissociated with Oceania in every way.': ['papua new guinea'],\n",
       " 'David Hayter wrote X-Men (film).': ['x men  film '],\n",
       " \"The 84th Academy Awards' winners included The Iron Lady and The Descendants.\": ['84th academy awards',\n",
       "  'the descendants',\n",
       "  'the iron lady  film '],\n",
       " 'Jack Black has been nominated for Golden Globe Awards.': ['jack black'],\n",
       " 'Michelle Williams began her career on television.': ['michelle williams  actress '],\n",
       " 'Jodie Foster played an FBI trainee looking into a murder case.': ['jodie foster'],\n",
       " 'In California, Little Miss Sunshine was filmed.': ['little miss sunshine'],\n",
       " 'Denmark is an absolute monarchy.': ['denmark'],\n",
       " \"Julius Caesar's office was also called dictator in perpetuum and he died.\": ['julius caesar',\n",
       "  'dictator perpetuo'],\n",
       " 'Taylor Swift is not a singer-songwriter.': ['taylor swift'],\n",
       " 'John Constantine was originally a supporting character.': ['john constantine'],\n",
       " \"Aneurin Barnard's birth year is 1987.\": ['aneurin barnard'],\n",
       " 'The 20th is the day Diana Rigg was born.': ['diana rigg'],\n",
       " 'Punk rock was made in the United States.': ['punk rock'],\n",
       " 'Geraldine Chaplin got a Golden Globe nomination.': ['geraldine chaplin'],\n",
       " 'Paranormal pertains to extrasensory perception.': ['paranormal'],\n",
       " 'Cindy McCain is the spouse of John McCain.': ['cindy mccain'],\n",
       " 'There is an episode of Futurama.': ['futurama'],\n",
       " \"One of Future's studio albums was published in 2017.\": ['future  rapper ',\n",
       "  'future  future album '],\n",
       " 'Macbeth was written by William Shakespeare.': ['macbeth'],\n",
       " \"Arnold is Al Gore's middle name.\": ['al gore'],\n",
       " 'British Fantasy Award categories include Best Novella and Best Short Story.': ['british fantasy award'],\n",
       " 'Pompeii is in Spain.': ['pompeii'],\n",
       " \"George W. Bush's brother ran for president of the United States.\": ['george w  bush'],\n",
       " 'The Red Army invasion of Georgia is also known as the Soviet Invasion of Georgia.': ['red army invasion of georgia'],\n",
       " 'Black Panther is a newspaper.': ['black panther  film '],\n",
       " 'Francois de Belleforest translated the works of Cicero into anything except French.': ['françois de belleforest'],\n",
       " 'Wonder Woman is skilled in hunting.': ['wonder woman'],\n",
       " 'David Schwimmer graduated from a university based in Guam.': ['david schwimmer'],\n",
       " 'Dallas, Texas is where Stevie Ray Vaughan was raised.': ['stevie ray vaughan'],\n",
       " 'Alex Rodriguez never played for Seattle.': ['alex rodriguez'],\n",
       " 'A Wrinkle in Time has been made into other media types.': ['a wrinkle in time',\n",
       "  'a wrinkle in time',\n",
       "  'a wrinkle in time'],\n",
       " 'Sister Act stars an American performer.': ['sister act',\n",
       "  'harvey keitel',\n",
       "  'kathy najimy'],\n",
       " 'Thiokol was interested in entities that propel rockets.': ['thiokol'],\n",
       " 'Michael Jordan helped popularize the NHL.': ['michael jordan'],\n",
       " 'Barbara Bain is only German.': ['barbara bain'],\n",
       " 'Sharon Tate starred in The Fearless Vampire Killers.': ['sharon tate'],\n",
       " 'Adrianne Palicki was an actress from America.': ['adrianne palicki'],\n",
       " 'Los Angeles is incorporated as a municipality.': ['los angeles'],\n",
       " 'Tom Hardy has been in miniseries produced by both the United States and Great Britain.': ['tom hardy',\n",
       "  'peaky blinders  tv series ',\n",
       "  'band of brothers  miniseries '],\n",
       " 'The capital of Japan is Tokyo.': ['tokyo'],\n",
       " 'Daft Punk got reviews for their album that were positive.': ['daft punk'],\n",
       " 'The latest album of LL Cool J goes by a name.': ['ll cool j'],\n",
       " 'Bruce Willis is from America.': ['bruce willis'],\n",
       " 'Lily Collins has worked with John Singleton on the action thriller film Abduction.': ['lily collins',\n",
       "  'abduction  2011 film '],\n",
       " 'Little Big Shots premiered on a channel.': ['little big shots', 'nbc'],\n",
       " 'Bane is a villain.': ['bane  comics '],\n",
       " 'Lynyrd Skynyrd was a Midwestern rock band.': ['lynyrd skynyrd', 'florida'],\n",
       " 'Laura Linney was in Primal Fear.': ['laura linney'],\n",
       " 'The Prestige is a 2006 film.': ['the prestige  film '],\n",
       " 'The Outcasts is a 2017 movie.': ['the outcasts  2017 film '],\n",
       " 'Roald Dahl is a British writer.': ['roald dahl', 'roald dahl'],\n",
       " 'Machine Gun Kelly did not release A Little More.': ['machine gun kelly  rapper '],\n",
       " 'Selena was murdered by a jealous ex-lover.': ['selena'],\n",
       " 'Steve Irwin was not born in 1962.': ['steve irwin'],\n",
       " 'Mr. Sunshine began its run on February 9.': ['mr  sunshine  2011 tv series '],\n",
       " 'David Beckham was playing football in 1999.': ['david beckham'],\n",
       " 'Rafael Nadal is a male trumpeter': ['rafael nadal'],\n",
       " 'Kristen Bell was in When In Rome which was released in 2010.': ['kristen bell'],\n",
       " 'Matt Kuchar plays on the PGA Tour.': ['matt kuchar'],\n",
       " 'Giacomo Casanova was Italian.': ['giacomo casanova'],\n",
       " 'Ringo Starr has been hospitalized.': ['ringo starr'],\n",
       " 'Prince is a top selling artist.': ['prince  musician '],\n",
       " 'Fiji is a republic.': ['fiji'],\n",
       " 'CeeLo Green is a musical artist.': ['ceelo green'],\n",
       " 'The Second Continental Congress commissioned George Washington.': ['george washington'],\n",
       " 'Las Vegas is famous for its shopping.': ['las vegas'],\n",
       " 'Nepal is a developing nation.': ['nepal'],\n",
       " 'Allen Ginsberg wrote the poem \"September on Jessore Road.\"': ['allen ginsberg'],\n",
       " 'On September 11, 2016, The Promise had its premiere.': ['the promise  2016 film '],\n",
       " 'David Schwimmer graduated from a university based in Dallas, Texas.': ['david schwimmer',\n",
       "  'northwestern university'],\n",
       " 'Alive 2006/2007 was a tour by a French electronica music duo.': ['alive 2006 2007'],\n",
       " 'Cheyenne Jackson is a squid.': ['cheyenne jackson'],\n",
       " 'John Lennon was a member of the most commercially accomplished band in history.': ['john lennon'],\n",
       " 'Dr. Dre put out Dr. Dre Presents the Aftermath in 1996.': ['dr  dre'],\n",
       " \"Conan O'Brien is an entertainer.\": ['conan o brien'],\n",
       " 'My Summer of Love is a 2004 British drama film.': ['my summer of love'],\n",
       " 'Diego Luna is not a director.': ['diego luna'],\n",
       " 'Collision Course features the Grammy-winning single Numb/Encore.': ['collision course  album '],\n",
       " 'A mole is usually made of milk.': ['mole  architecture '],\n",
       " 'The Wolfman stars Anthony Hopkins and Benicio Del Toro.': ['the wolfman  2010 film '],\n",
       " 'My Bloody Valentine 3D stars an American actor whose birth year is 1972.': ['my bloody valentine 3d',\n",
       "  'kerr smith'],\n",
       " 'Monica Seles was born in SFR Yugoslavia.': ['monica seles'],\n",
       " 'Lily James appeared in television roles.': ['lily james'],\n",
       " 'Rob Lowe was in the cast of at least one television series.': ['rob lowe',\n",
       "  'rob lowe',\n",
       "  'rob lowe'],\n",
       " 'Tardigrades are eight-legged.': ['tardigrade'],\n",
       " 'The Flash was on CBS.': ['the flash  1990 tv series '],\n",
       " 'Paul Thomas Anderson worked with Philip Seymour Hoffman and gained recognition.': ['paul thomas anderson',\n",
       "  'magnolia  film '],\n",
       " 'Titus destroyed the Second Temple.': ['titus'],\n",
       " 'Major League Soccer takes place in the United States and Canada.': ['major league soccer'],\n",
       " 'Mary Tyler Moore died from cardiopulmonary.': ['mary tyler moore'],\n",
       " 'Jeff Ament released his final album in 2005.': ['jeff ament'],\n",
       " 'Martin Luther King Jr. did not win the Congressional Gold Medal.': ['martin luther king jr '],\n",
       " 'Floyd Mayweather Jr. is a professional boxer.': ['floyd mayweather jr '],\n",
       " 'Andrew Jackson was Canadian.': ['andrew jackson', 'andrew jackson'],\n",
       " 'Davis Guggenheim is an American film director.': ['davis guggenheim'],\n",
       " 'Faith Evans made a screen debut.': ['faith evans'],\n",
       " 'Roger Moore was an English actor.': ['roger moore'],\n",
       " \"Empathy is the ability to feel from within the other person's frame of reference.\": ['empathy'],\n",
       " 'Elsa Pataky is a person from Spain.': ['elsa pataky'],\n",
       " 'In 1956, Martina Navratilova was born.': ['martina navratilova'],\n",
       " 'The Fast and the Furious had Michelle Rodriguez in its cast.': ['michelle rodriguez'],\n",
       " \"Medina became Muslim Empire's capital.\": ['medina'],\n",
       " 'Katherine Heigl declined to appear in Roswell.': ['katherine heigl'],\n",
       " 'John McCain is an American citizen.': ['john mccain'],\n",
       " 'Christina Aguilera sold 50 million albums worldwide as of 2015.': ['christina aguilera'],\n",
       " 'Glee was an unadapted book.': ['glee  tv series '],\n",
       " 'Nas is a person who raps.': ['nas'],\n",
       " 'Martin Scorsese did co-create the television series Vinyl.': ['martin scorsese'],\n",
       " 'Havoc is directed by Barbara Kopple in 2009.': ['havoc  2005 film '],\n",
       " 'Sunrise devised Code Geass R2.': ['sunrise  company '],\n",
       " 'Splatoon 2 is a prequel.': ['splatoon 2'],\n",
       " 'Terminator Salvation is directed by Brian De Palma.': ['terminator salvation'],\n",
       " 'Floyd Mayweather Jr. is British.': ['floyd mayweather jr '],\n",
       " 'Perth is the capitol of the nation Western Australia.': ['perth'],\n",
       " 'Gayathri Raguram started working as a choreographer.': ['gayathri raguram'],\n",
       " 'Jim Parsons stars in a show.': ['jim parsons',\n",
       "  'the big bang theory',\n",
       "  'jim parsons'],\n",
       " 'There is a movie that had commercial success called Snow White and the Seven Dwards (1937 film).': ['snow white and the seven dwarfs  1937 film '],\n",
       " 'Mexico is considered an upper-middle income country by the World Bank.': ['mexico'],\n",
       " 'Tom Brady has been in the Super Bowl a record seven times.': ['tom brady'],\n",
       " 'Doug Ducey is the 23rd governor of Arizona, holding office from 2012 to present.': ['doug ducey'],\n",
       " 'SpaceX is the name of a spaceship.': ['spacex'],\n",
       " 'Transformers: Dark of the Moon is the third film in the Transformers series.': ['transformers colon  dark of the moon'],\n",
       " 'Helike was a city.': ['helike', 'helike'],\n",
       " \"The Battle of Corinth was fought between the Roman Republic and Corinth's allies in the Achaean League.\": ['battle of corinth  146 bc '],\n",
       " 'Amazon is a more valuable retailer than Walmart.': ['amazon com'],\n",
       " 'Jason Sudeikis became an SNL cast member.': ['jason sudeikis'],\n",
       " 'Tyrion Lannister is portrayed by sheep.': ['tyrion lannister',\n",
       "  'peter dinklage'],\n",
       " 'Bob Arum is the CEO of Top Rank.': ['bob arum'],\n",
       " 'Sanjay Gupta had been considered for the Surgeon General of the United States position but removed his name from consideration.': ['sanjay gupta'],\n",
       " 'Central New York is dominated by water.': ['new york'],\n",
       " 'Wyatt Earp was a county sheriff.': ['wyatt earp'],\n",
       " \"1947 is O. J. Simpson's year of birth.\": ['o  j  simpson'],\n",
       " 'Daniel-Day Lewis had no leading roles.': ['daniel day lewis'],\n",
       " 'Peyton Manning is the third daughter of Archie Manning.': ['peyton manning'],\n",
       " 'Event management has only ever included arranging deaths.': ['event management'],\n",
       " 'Travis Barker collaborated with the alternative rock band +44 to make an album.': ['travis barker'],\n",
       " 'Lisa Lopes was in a group.': ['lisa lopes'],\n",
       " 'Samantha Robson is a performer.': ['samantha robson'],\n",
       " 'Alec Baldwin was in two movies directed by Martin Scorsese.': ['alec baldwin'],\n",
       " 'John Hughes wrote The Great Outdoors (film).': ['the great outdoors  film '],\n",
       " \"Top Gun's action sequences received admiration.\": ['top gun'],\n",
       " 'Joseph Gordon-Levitt was in a starring role in The Walk.': ['joseph gordon levitt',\n",
       "  'the walk  2015 film '],\n",
       " 'Leslie Groves was the director of a project that developed the atomic bomb during the second World War.': ['leslie groves'],\n",
       " 'Dawn of the Dead (1978 film) has never been remade.': ['dawn of the dead  1978 film '],\n",
       " 'Tanzania uses English in foreign trade, diplomacy, higher courts, and secondary education.': ['tanzania'],\n",
       " 'Maisie Williams is an English actress.': ['maisie williams'],\n",
       " \"U2 released the album All That You Can't Leave Behind in 2000.\": ['u2'],\n",
       " 'Ballet Shoes is by a Mexican author.': ['ballet shoes  novel ',\n",
       "  'noel streatfeild'],\n",
       " 'Paul Pogba has won zero Coppa Italia titles.': ['paul pogba', 'paul pogba'],\n",
       " 'Patrick Wilson (American actor) was a cast member of A Gifted Man.': ['patrick wilson  american actor '],\n",
       " 'Andre Agassi was the number 1 tennis player in the world at one point.': ['andre agassi'],\n",
       " 'Social justice is invoked today in efforts for gender equality in the US.': ['social justice'],\n",
       " 'Splatoon 2 is a board game.': ['splatoon 2'],\n",
       " 'Muhammad was a religious teacher.': ['muhammad'],\n",
       " 'The Wolfman had screenplay writers.': ['the wolfman  2010 film ',\n",
       "  'andrew kevin walker',\n",
       "  'david self'],\n",
       " 'William Shatner received two Emmy Awards.': ['william shatner'],\n",
       " 'Doctor Strange is a fictional superhero.': ['doctor strange'],\n",
       " 'British Columbia is a region.': ['british columbia'],\n",
       " 'Soundgarden had internal strife over its creative direction.': ['soundgarden'],\n",
       " 'Baahubali 2: The Conclusion is also called BB2.': ['baahubali 2 colon  the conclusion'],\n",
       " 'Madonna is an instrumental performer only.': ['madonna  entertainer '],\n",
       " 'The Himalayas has some of its mountains in Nepal.': ['himalayas',\n",
       "  'himalayas'],\n",
       " 'The Breakfast Club was directed by John Hughes.': ['the breakfast club'],\n",
       " 'Edward Norton has co-written for films.': ['edward norton'],\n",
       " 'G1 Climax is a professional wrestling tournament.': ['g1 climax'],\n",
       " 'Garry Kasparov is a former champion of a competition.': ['garry kasparov'],\n",
       " \"One Direction's Where We Are Tour was the highest grossing tour ever by a vocal group.\": ['one direction'],\n",
       " 'The 12-hour clock is a convention.': ['12 hour clock'],\n",
       " 'See You Again (Miley Cyrus song) remixed version was released on the 25th.': ['see you again  miley cyrus song '],\n",
       " 'The Hundred-Foot Journey (film) stars a casserole.': ['the hundred foot journey  film '],\n",
       " 'Ellyse Perry is from a country in Oceania.': ['ellyse perry'],\n",
       " 'John Denver is an American actor.': ['john denver'],\n",
       " 'Franklin Roosevelt had six children with Eleanor Roosevelt, all while they were married.': ['franklin d  roosevelt'],\n",
       " 'Kiefer Sutherland was born on May 21st, 1966.': ['kiefer sutherland'],\n",
       " 'Heikegani is native to Japan.': ['heikegani'],\n",
       " 'In past ages, elephants were used in battle.': ['elephant'],\n",
       " 'The Fosters is a television series.': ['the fosters  2013 tv series '],\n",
       " 'Telangana is a part of Asia.': ['telangana', 'india'],\n",
       " 'Basketball is played with a ball.': ['basketball'],\n",
       " 'Bangalore was captured after a conflict in South India.': ['bangalore',\n",
       "  'kingdom of mysore'],\n",
       " 'George VI had multiple daughters.': ['george vi'],\n",
       " 'Connaught Tunnel is under a mountain range.': ['connaught tunnel',\n",
       "  'selkirk mountains'],\n",
       " \"We Found Love's music video was directed by an American director who has only done commercials.\": ['we found love',\n",
       "  'melina matsoukas'],\n",
       " 'Jackie Evancho appeared in a 2013 film.': ['jackie evancho'],\n",
       " 'The Legend of Tarzan (film) is a film that has a negative revenue.': ['the legend of tarzan  film '],\n",
       " 'Richard Harris was born on October 25, 2002.': ['richard harris'],\n",
       " \"Jennifer Garner's husband was an actor.\": ['jennifer garner', 'scott foley'],\n",
       " 'The Renaissance was a period in European history from the 14th to 17th century.': ['renaissance'],\n",
       " 'The Bold and the Beautiful is related to The Young and the Restless.': ['the bold and the beautiful'],\n",
       " 'Tom Hardy played Bane in The Dark Knight Rises (2012).': ['tom hardy'],\n",
       " 'Home Alone was released in 1980.': ['home alone'],\n",
       " 'The Gadsden flag was named after a chess move.': ['gadsden flag'],\n",
       " 'Audrey Horne was introduced in Twin Peaks.': ['audrey horne',\n",
       "  'pilot  twin peaks '],\n",
       " 'Gregor Clegane is a person.': ['gregor clegane'],\n",
       " 'Artemis was the protector of young girls and also hunted.': ['artemis'],\n",
       " 'Glen Campbell has not won Grammy Hall of Fame Awards.': ['glen campbell'],\n",
       " 'Berlin is influenced by a Mediterranean climate.': ['berlin'],\n",
       " 'Leslie Uggams was in a superhero movie.': ['leslie uggams',\n",
       "  'deadpool  film '],\n",
       " 'Get Out stars Daniel Kaluuya in a role.': ['get out  film '],\n",
       " 'Gilmore Girls returned for a four-part miniseries.': ['gilmore girls'],\n",
       " 'Lee Min-ho has been in a movie.': ['lee min ho  actor  born 1987 '],\n",
       " 'Dennis Hopper took photos.': ['dennis hopper'],\n",
       " 'The Homesman features an award-winning actress.': ['the homesman',\n",
       "  'hilary swank',\n",
       "  'meryl streep'],\n",
       " 'The Germanic peoples are enemies with the Suebian.': ['germanic peoples'],\n",
       " 'Evolution was by someone born in May.': ['evolution  sabrina carpenter album ',\n",
       "  'sabrina carpenter'],\n",
       " 'Margaret Atwood has published short stories in a Canadian general interest magazine.': ['margaret atwood',\n",
       "  'saturday night  magazine '],\n",
       " 'Elvis Presley never owned Graceland.': ['elvis presley', 'graceland'],\n",
       " '10 Cloverfield Lane is a book in the Cloverfield franchise.': ['10 cloverfield lane'],\n",
       " 'Morgan Freeman appeared in Deep Impact.': ['morgan freeman'],\n",
       " 'The Godfather Part III was nominated for seven Academy Awards.': ['the godfather part iii'],\n",
       " 'Adam Driver was in the singing group Lincoln.': ['adam driver'],\n",
       " 'Jerry Goldsmith was denied any nominations for Academy Awards.': ['jerry goldsmith'],\n",
       " 'Xi Jinping joined the Politburo Standing Committee.': ['xi jinping'],\n",
       " 'Cindy McCain is chair of a big Anheuser-Busch distributor of beer.': ['cindy mccain'],\n",
       " 'There is an American film called Funny Girl (film).': ['funny girl  film '],\n",
       " 'Khal Drogo was introduced in 1796.': ['khal drogo'],\n",
       " 'Michelle Rodriguez has won an award.': ['michelle rodriguez'],\n",
       " 'Mexico is the least populous country in Latin America.': ['mexico'],\n",
       " 'Minnesota has a high standard of living.': ['minnesota'],\n",
       " 'Bela Lugosi was a horror film actor.': ['bela lugosi'],\n",
       " 'Billy Clanton was an only child.': ['billy clanton'],\n",
       " 'As the World Turns was replaced by an American talk show that debuted in the fall of 2010.': ['as the world turns',\n",
       "  'the talk  tv series '],\n",
       " 'Trevor Berbick died on October 29th, 2006.': ['trevor berbick'],\n",
       " 'Naruto is a manga written and illustrated by Masashi Kishimoto.': ['naruto'],\n",
       " 'Richmond, Virginia is a neighbor to the Federal Reserve Bank of Richmond.': ['richmond  virginia',\n",
       "  'richmond  virginia'],\n",
       " 'Some spider species are social and construct communal webs.': ['spider'],\n",
       " \"Reese Witherspoon's breakthrough role was in an adaptation of a novel.\": ['reese witherspoon',\n",
       "  'legally blonde'],\n",
       " 'Alicia Silverstone was a star in a film directed by Amy Heckerling.': ['alicia silverstone',\n",
       "  'clueless  film '],\n",
       " 'Good Will Hunting is a political-drama.': ['good will hunting'],\n",
       " 'Justin Bieber has won things.': ['justin bieber'],\n",
       " 'Malcolm Young co-founded AC/DC in July 1973.': ['malcolm young'],\n",
       " 'Barbados is not considered part of the Caribbean.': ['barbados'],\n",
       " 'Oliver Reed was born in a month in 1938.': ['oliver reed'],\n",
       " 'Vincente Minnelli is American.': ['vincente minnelli'],\n",
       " 'Richard Nixon was involved in politics.': ['richard nixon'],\n",
       " 'J. K. Rowling had a child.': ['j  k  rowling'],\n",
       " '42 (film) is a film that grossed over $97 million dollars.': ['42  film '],\n",
       " 'There is a professional golfer name Tiger Woods.': ['tiger woods'],\n",
       " 'Paul Wesley is the professional alias of Paul Tomasz Wasilewski.': ['paul wesley'],\n",
       " 'Twenty One Pilots is a musical group.': ['twenty one pilots',\n",
       "  'twenty one pilots'],\n",
       " \"Spotlight was released in the 2010's.\": ['spotlight  film '],\n",
       " 'The memory of Titanic is kept alive in different works.': ['rms titanic',\n",
       "  'rms titanic'],\n",
       " 'Bob Arum is only the founder of a professional soccer company.': ['bob arum'],\n",
       " \"Giacomo Casanova's birth month is April.\": ['giacomo casanova'],\n",
       " 'Jeff Bezos was born in January of 1964.': ['jeff bezos'],\n",
       " 'There is a character named Fred in Scooby-Doo.': ['scooby doo'],\n",
       " 'Hotel Hell is broadcast on Fox.': ['hotel hell'],\n",
       " 'Haitian Creole is French-based and it is an important language.': ['haitian creole'],\n",
       " 'Jerry Seinfeld was in the sitcom Seinfeld, which he also created and wrote.': ['jerry seinfeld'],\n",
       " 'The Incredible Hulk is a motion picture.': ['the incredible hulk  film '],\n",
       " 'IBM invented a multi-purpose electronic computer intended for individual use.': ['ibm',\n",
       "  'personal computer'],\n",
       " 'Up All Night was released by Syco Records in 2011.': ['up all night  one direction album '],\n",
       " 'Sammy Cahn died in the 90s.': ['sammy cahn'],\n",
       " 'The screenplay for the film Logan (film) was co-written by James Mangold.': ['logan  film '],\n",
       " 'The Beach Boys is a group.': ['the beach boys', 'the beach boys'],\n",
       " 'Gimli is from Middle-earth.': ['gimli  middle earth '],\n",
       " 'Year Zero is a single.': ['year zero  album '],\n",
       " 'Howard Stern developed his on show from 1976 to 1982.': ['howard stern'],\n",
       " 'The Magna Carta was typically renewed by each British monarch.': ['magna carta'],\n",
       " 'A reflex is made possible by neural pathways that act on an impulse before it reaches the brain.': ['reflex'],\n",
       " 'Nepal is 21 kilometers away from Bangladesh.': ['nepal'],\n",
       " 'Aishwarya Rai appeared in Raincoat.': ['aishwarya rai'],\n",
       " 'Amy Adams played Margaret Keane in Big Eyes (2014).': ['amy adams'],\n",
       " 'Nicki Minaj wrote and sang the song Super Bass.': ['nicki minaj',\n",
       "  'super bass'],\n",
       " \"Beauty Shop's character Gina was originally presented in Barbershop 2: Back in Business.\": ['beauty shop'],\n",
       " 'Game of Thrones had Diana Rigg nominated for an award.': ['game of thrones'],\n",
       " 'Contained in the Bible are narratives.': ['bible'],\n",
       " 'The Amanda Show was the second TV show created by Dan Schneider.': ['the amanda show',\n",
       "  'dan schneider  tv producer '],\n",
       " 'Travis Scott is an American citizen.': ['travis scott'],\n",
       " 'American Horror Story: Hotel premiered on October 7, 2015.': ['american horror story colon  hotel'],\n",
       " 'Planet of the Apes (1968 film) was written by someone from America.': ['planet of the apes  1968 film ',\n",
       "  'michael wilson  writer ',\n",
       "  'rod serling'],\n",
       " 'Andhra Pradesh is an Indian restaurant.': ['andhra pradesh'],\n",
       " 'Portal 2 was released for a platform.': ['portal 2', 'steam  software '],\n",
       " 'Malaysia Airlines started a plan.': ['malaysia airlines'],\n",
       " 'Rhona Mitra is from England.': ['rhona mitra'],\n",
       " 'A movie in 1969 featured Oliver Reed.': ['oliver reed', 'hannibal brooks'],\n",
       " 'Tamera Mowry is in Sister, Sister.': ['tamera mowry'],\n",
       " 'Cricket has batsmen.': ['cricket'],\n",
       " 'Leigh Steinberg was a consultant on Jerry Maguire.': ['jerry maguire'],\n",
       " 'Red Velvet (band) is a girl group.': ['red velvet  band '],\n",
       " 'Born Naked was concocted by a singer-songwriter.': ['born naked', 'rupaul'],\n",
       " \"In the 1990's Salman Khan worked in Bollywood.\": ['salman khan'],\n",
       " 'My Sweet Lord is an album.': ['my sweet lord'],\n",
       " 'John Lennon was in the most commercially successful band in history.': ['john lennon'],\n",
       " 'Spider-Man is a horror movie franchise.': ['spider man'],\n",
       " \"Kevin Brodbin was a writer of Constantine's screenplay.\": ['constantine  film '],\n",
       " 'Anaconda is on the third studio album by Nicki Minaj.': ['anaconda  nicki minaj song '],\n",
       " 'Eagles (band) made an album called Their Greatest Hits (1971 -- 1975) that was ranked among the 20 best-selling albums in the United States.': ['eagles  band '],\n",
       " 'San Junipero is not from Britain.': ['san junipero'],\n",
       " 'Morgan Freeman was an actor in The Shawshank Redemption.': ['morgan freeman',\n",
       "  'the shawshank redemption'],\n",
       " 'Horrible Bosses is an Ecuadorian film.': ['horrible bosses'],\n",
       " 'Robert Redford guest starred on The Untouchables.': ['robert redford'],\n",
       " 'The Germanic peoples are of Southern Canadian origin.': ['germanic peoples',\n",
       "  'germanic peoples'],\n",
       " 'Brittany Murphy was born in Texas.': ['brittany murphy'],\n",
       " 'The Boys from Brazil features Uta Hagen.': ['the boys from brazil  film '],\n",
       " 'Get Out stars Brad Pitt.': ['get out  film ',\n",
       "  'get out  film ',\n",
       "  'get out  film ',\n",
       "  'get out  film '],\n",
       " 'Alpha Centauri can be abbreviated as Alpha Cen.': ['alpha centauri'],\n",
       " 'R. Madhavan was in the cast of the drama film Rang De Basanti.': ['r  madhavan'],\n",
       " 'Walt Whitman volunteered during a war that was in a country.': ['walt whitman',\n",
       "  'american civil war'],\n",
       " 'Shawn Mendes and Island Records signed a deal.': ['shawn mendes'],\n",
       " 'Negan is a fictional character in The Walking Dead.': ['negan'],\n",
       " 'Stanley Kubrick worked on Dr. Strangelove.': ['stanley kubrick'],\n",
       " 'Furia is written by anyone except Gregory Levasseur.': ['furia  film '],\n",
       " 'Count Basie formed a group.': ['count basie'],\n",
       " 'Tupac Shakur was born Lesane Parish Crooks.': ['tupac shakur'],\n",
       " 'Gerard Lee was born in the 1950s.': ['gerard lee'],\n",
       " 'North Vancouver is served by the North Vancouver Fire Department.': ['north vancouver  district municipality '],\n",
       " 'Carrie Fisher was a script doctor.': ['carrie fisher'],\n",
       " 'Gwen Stefani was in a band.': ['gwen stefani', 'gwen stefani'],\n",
       " 'Water has an effect on the texture of Vitamin B-12.': ['vitamin b12'],\n",
       " 'Bruce Springsteen received no honors or awards.': ['bruce springsteen'],\n",
       " 'Papua New Guinea is an Oceanian country.': ['papua new guinea'],\n",
       " 'Bam Margera is a professional skateboarder.': ['bam margera'],\n",
       " 'Steve Buscemi was a cast member in a film.': ['steve buscemi'],\n",
       " 'Jackie Robinson died in 1972.': ['jackie robinson'],\n",
       " 'Tall Story is a North American film.': ['tall story'],\n",
       " \"Sofia Coppola's father is Abraham Lincoln.\": ['sofia coppola'],\n",
       " 'David Tennant got the National Television Award for Special Recognition.': ['david tennant'],\n",
       " 'Carey Taylor did not join Slipknot in 1997.': ['corey taylor'],\n",
       " \"Heartlight is the first track on Diamond's 1982 album.\": ['heartlight  song '],\n",
       " 'Justin Timberlake is a record producer.': ['justin timberlake'],\n",
       " 'R. Kelly has only sold over 10 million records worldwide.': ['r  kelly'],\n",
       " \"Ryan O'Neal acts professionally.\": ['ryan o neal'],\n",
       " 'George Lucas created the Star Wars franchise.': ['george lucas'],\n",
       " 'Adderall affects control.': ['adderall'],\n",
       " \"The University of Oxford operates the world's oldest university museum.\": ['university of oxford'],\n",
       " 'Derrick Rose does not play for the New York Knicks.': ['derrick rose'],\n",
       " 'Islam had a prophet.': ['islam'],\n",
       " 'Tiger Woods is a sports player.': ['tiger woods'],\n",
       " 'Nepal has a population.': ['nepal'],\n",
       " 'The Fate of the Furious premiered in Berlin.': ['the fate of the furious'],\n",
       " 'Kristen Stewart has avoided the acting profession entirely.': ['kristen stewart'],\n",
       " 'Charles Marie de La Condamine was born in January 1701.': ['charles marie de la condamine'],\n",
       " 'Agatha Christie avoided professional writing her entire life.': ['agatha christie'],\n",
       " 'Yale School of Drama provided training in acting.': ['yale school of drama'],\n",
       " 'Laurence Fishburne acted in a work.': ['laurence fishburne'],\n",
       " 'In 1918, Azerbaijan proclaimed its independence.': ['azerbaijan'],\n",
       " 'Selene serves as a character.': ['selene  underworld '],\n",
       " 'The Champ stars Ricky Schroder in the lead role.': ['the champ  1979 film '],\n",
       " 'John Stewart is a fictional person with super powers.': ['john stewart  comics ',\n",
       "  'superhero'],\n",
       " 'Steven Gerrard represented his country at fifty FIFA World Cups.': ['steven gerrard'],\n",
       " 'James Nesbitt starred in at least one television series.': ['james nesbitt'],\n",
       " 'Odin is accompanied by animal companions.': ['odin'],\n",
       " 'Steven Tyler is a former television music competition judge.': ['steven tyler'],\n",
       " 'The Rolling Stones are a English rock band.': ['the rolling stones'],\n",
       " 'Aishwarya Rai was in several television commercials.': ['aishwarya rai'],\n",
       " 'Randy Orton was born on April 1.': ['randy orton'],\n",
       " 'WeChat is a German application.': ['wechat'],\n",
       " 'Patrick Cutrone is a person.': ['patrick cutrone'],\n",
       " 'Sue Vertue was born in September.': ['sue vertue'],\n",
       " \"God in Islam's theology is all-powerful and all-knowing.\": ['god in islam'],\n",
       " 'Zeus is the last of his siblings to be born.': ['zeus'],\n",
       " 'Deadpool 2 featured Ryan Reynolds, Morena Baccarin, Ed Skrein, T. J. Miller, Gina Carano, Leslie Uggams, Brianna Hildebrand, and Stefan Kapičić.': ['deadpool  film ',\n",
       "  'deadpool  film ',\n",
       "  'deadpool  film '],\n",
       " 'Fifty Shades of Grey is a romance novel.': ['fifty shades of grey'],\n",
       " 'Gone Girl lacks a performance by Neil Patrick Harris.': ['gone girl  film '],\n",
       " 'Liverpool F.C. was the ninth highest-earning football club in the world for 2014-2015.': ['liverpool f c '],\n",
       " 'Buddy Holly played in Lubbock.': ['buddy holly'],\n",
       " 'Cosmetics commonly include hair gel.': ['cosmetics'],\n",
       " 'Wallander is a series.': ['wallander  uk tv series '],\n",
       " 'George A. Romero worked on the horror movie The Crazies.': ['george a  romero',\n",
       "  'the crazies  1973 film '],\n",
       " 'Patrick Bateman works as an investment banker.': ['patrick bateman'],\n",
       " 'Love & Mercy (film) was unable to cast Elizabeth Banks.': ['love   mercy  film '],\n",
       " \"Since 2000, Luxembourg's Grand Duke has been Henri.\": ['luxembourg',\n",
       "  'henri  grand duke of luxembourg'],\n",
       " 'Brian Lynch was the beginning writer for Angel: After the Fall.': ['brian lynch  writer '],\n",
       " 'Serena Williams is a golf player.': ['serena williams'],\n",
       " 'Coldplay released The Blue Room in 1995.': ['coldplay'],\n",
       " \"Alison Brie's full name is Alison Brie Lewis.\": ['alison brie'],\n",
       " 'Tequila is an arbitrary name.': ['tequila'],\n",
       " 'The Jim Crow laws mandated segregation.': ['jim crow laws'],\n",
       " 'Saswata Chatterjee refuses to work in television.': ['saswata chatterjee'],\n",
       " 'North Korea is bordered.': ['north korea',\n",
       "  'north korea',\n",
       "  'north korea',\n",
       "  'north korea'],\n",
       " 'Iris Murdoch refused to engage in philosophy.': ['iris murdoch'],\n",
       " 'Kristen Bell has appeared on television.': ['kristen bell', 'veronica mars'],\n",
       " 'Laurie Hernandez was conceived on June 9th, 2000.': ['laurie hernandez'],\n",
       " 'The Democratic Republic of the Congo is a video game.': ['democratic republic of the congo'],\n",
       " 'Mauritius was a French embassy.': ['mauritius'],\n",
       " 'Leyton Orient F.C. is a club.': ['leyton orient f c ', 'leyton orient f c '],\n",
       " 'Collision Course is a single song.': ['collision course  album '],\n",
       " 'Kris Kristofferson collaborated with Nashville songwriters.': ['kris kristofferson'],\n",
       " 'Little Miss Sunshine had a wider release on August 18.': ['little miss sunshine'],\n",
       " \"Birth of the Dragon's principal photography began in a city.\": ['birth of the dragon',\n",
       "  'vancouver'],\n",
       " 'Emily Browning starred in Something in the Air.': ['emily browning'],\n",
       " 'Angela Lansbury is from Germany.': ['angela lansbury'],\n",
       " 'Larry Junstrom is American.': ['larry junstrom'],\n",
       " 'Kristen Bell was in a movie.': ['kristen bell',\n",
       "  'kristen bell',\n",
       "  'kristen bell',\n",
       "  'veronica mars  film '],\n",
       " 'The Existence of God has been argued by René Descartes.': ['existence of god'],\n",
       " 'Adam DeVine was involved in voice acting in animation films.': ['adam devine'],\n",
       " 'Star Wars is centered on a film series.': ['star wars'],\n",
       " 'Daniela Hantuchová beat a tennis player.': ['daniela hantuchová',\n",
       "  'martina hingis'],\n",
       " 'Baloo was featured in The Jungle Book.': ['baloo'],\n",
       " 'Minnesota was inhabited by the native Ojibwe/Anishinaabe.': ['minnesota',\n",
       "  'anishinaabe',\n",
       "  'ojibwe'],\n",
       " 'Shonen Jump is banned in North America.': ['shonen jump  magazine '],\n",
       " 'Samantha Robson was born in 1966.': ['samantha robson'],\n",
       " 'Alandi is in the state of New Jersey.': ['alandi'],\n",
       " 'Ayn Rand was an advocate for free and open trade between private citizens without governmental interference.': ['ayn rand',\n",
       "  'laissez faire'],\n",
       " 'No one died from lymphoma in 2012.': ['lymphoma'],\n",
       " 'Thinkin Bout You was nominated for Record of the Year in 2013.': ['thinkin bout you'],\n",
       " \"Faith Evans's fifth album is called Thriller.\": ['faith evans'],\n",
       " 'Heinrich Himmler never held a position in the Nazi Party.': ['heinrich himmler'],\n",
       " 'Alec Baldwin co-starred in 30 Rock.': ['30 rock', 'alec baldwin'],\n",
       " 'Everybody Needs a Best Friend was composed by a person.': ['everybody needs a best friend',\n",
       "  'walter murphy'],\n",
       " 'Emily Ratajkowski was the leading role in We Are Your Friends in 2015.': ['emily ratajkowski'],\n",
       " 'Marlon Brando was in a film in 1953.': ['marlon brando', 'the wild one'],\n",
       " 'The 2017 Open Championship is a July golf championship.': ['2017 open championship'],\n",
       " 'Little Boy was dropped on the city of Boston.': ['little boy'],\n",
       " 'Harry Styles and his bandmates released the single Take Me Home.': ['harry styles'],\n",
       " 'Roger Federer held the award from Laureus.': ['roger federer'],\n",
       " 'Divergent was released on DVD.': ['divergent  film '],\n",
       " 'Eric Singer has done a performance with Lita Ford.': ['eric singer'],\n",
       " 'La La Anthony was a 2016 movie.': ['la la anthony'],\n",
       " 'Fantastic Beasts and Where to Find Them premiered in New York City.': ['fantastic beasts and where to find them  film ',\n",
       "  'fantastic beasts and where to find them  film '],\n",
       " 'Pirates of the Caribbean is set on the back of a fictional turtle.': ['pirates of the caribbean  film series '],\n",
       " ...}"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "claim_to_article"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['Nikolaj Coster-Waldau worked with the Fox Broadcasting Company.',\n",
       " 'Nikolaj Coster-Waldau worked with the Fox Broadcasting Company.',\n",
       " 'Roman Atwood is a content creator.',\n",
       " 'History of art includes architecture, dance, sculpture, music, painting, poetry literature, theatre, narrative, film, photography and graphic arts.',\n",
       " 'Adrienne Bailon is an accountant.',\n",
       " 'Homeland is an American television spy thriller based on the Israeli television series Prisoners of War.',\n",
       " 'Homeland is an American television spy thriller based on the Israeli television series Prisoners of War.',\n",
       " 'The Boston Celtics play their home games at TD Garden.',\n",
       " 'The Ten Commandments is an epic film.',\n",
       " 'Tetris has sold millions of physical copies.',\n",
       " 'Cyndi Lauper won the Best New Artist award at the 27th Grammy Awards in 1985.',\n",
       " 'There is a movie called The Hunger Games.',\n",
       " 'Ryan Gosling has been to a country in Africa.',\n",
       " 'Ryan Gosling has been to a country in Africa.',\n",
       " 'Stranger Things is set in Bloomington, Indiana.',\n",
       " 'Ryan Seacrest is a person.',\n",
       " 'Puerto Rico is not an unincorporated territory of the United States.',\n",
       " 'Michael Giacchino composed the score for Doctor Strange.',\n",
       " 'Stranger than Fiction is a film.',\n",
       " 'Chris Hemsworth appeared in A Perfect Getaway.',\n",
       " 'Selena recorded music.',\n",
       " \"Robert J. O'Neill was born April 10, 1976.\",\n",
       " 'The Silence of the Lambs was a film starring Scott Glenn.',\n",
       " 'Peggy Sue Got Married is a Egyptian film released in 1986.',\n",
       " 'Peggy Sue Got Married is a Egyptian film released in 1986.',\n",
       " 'Andy Roddick lost 5 Master Series between 2002 and 2010.',\n",
       " 'As the Vietnam War raged in 1969, Yoko Ono and her husband John Lennon did not have two week-long Bed-Ins for Peace.',\n",
       " 'Tupac Shakur was born Lesane Parish Crooks.',\n",
       " 'The Jim Henson Company produced The Muppet Movie, The Dark Crystal, and Labyrinth.',\n",
       " 'Slovenia uses the euro.',\n",
       " 'Slovenia uses the euro.',\n",
       " 'Iowa is a part of the Midwestern United States.',\n",
       " 'Saratoga is an American film from 1937.',\n",
       " 'J. Howard Marshall was a baby.',\n",
       " 'J. Howard Marshall was a baby.',\n",
       " 'Grace Jones is a dancer.',\n",
       " 'Lisbon has a population larger than 1.',\n",
       " 'Willie Nelson dropped out of college after three years.',\n",
       " 'Malcolm Young was the co-founder of Australian hard rock band AC/DC.',\n",
       " 'Newfoundland and Labrador is the most linguistically homogeneous of Canada.',\n",
       " 'Furia is adapted from a short story by Anna Politkovskaya.',\n",
       " 'One state of the United States has Russia to its west.',\n",
       " 'Sophie Turner was born in the 1990s.',\n",
       " 'Mother Teresa was made a saint by the church.',\n",
       " 'The Smurfs (film) was released.',\n",
       " \"C. S. Forester's first name was Carl.\",\n",
       " 'Kong: Skull Island is a book.',\n",
       " 'The Challenge was a scripted show.',\n",
       " 'Berlin is the capital of Germany.',\n",
       " 'South Korea has a highly educated workforce.',\n",
       " 'Hacksaw Ridge came out in America on November 4, 2016.',\n",
       " 'Michael Fassbender is an actor.',\n",
       " 'Red Headed Stranger is a movie.',\n",
       " 'Paul Bettany has played Vision in at least two works.',\n",
       " \"Scotland's Hebrides is widespread and diverse with many islands.\",\n",
       " \"Scotland's Hebrides is widespread and diverse with many islands.\",\n",
       " 'Uzbekistan is a part of the Commonwealth of Independent States (CIS).',\n",
       " 'Charles, Prince of Wales is patron of numerous other organizations.',\n",
       " 'Chester Bennington is not a singer.',\n",
       " 'Vincent Cassel played Jacques Mesrine in at least two films.',\n",
       " 'Pope John Paul II co-stars many actors besides Christopher Lee.',\n",
       " 'David Beckham has zero middle names.',\n",
       " 'Indiana Jones has only been portrayed by Harrison Ford.',\n",
       " 'Brian Wilson was part of the Beach Boys.',\n",
       " 'The Great Gatsby centers on a youthful person with over a million dollars.',\n",
       " 'Shane Black and Chris Miller wrote Iron Man 3.',\n",
       " 'La La Anthony was conceived on June 25th, 1979.',\n",
       " 'Led Zeppelin is a band.',\n",
       " 'Richard Harris was born on October 25, 2002.',\n",
       " 'The Fosters is a television series.',\n",
       " \"Blair is Jonathan Hensleigh's middle name.\",\n",
       " 'Filmfare is about cheese.',\n",
       " 'Buckingham Palace lacks brightly colored scagliola.',\n",
       " 'Sarah Paulson makes an appearance in What Women Want.',\n",
       " 'David Harbour is an American.',\n",
       " 'The terrain of Kazakhstan includes taiga.',\n",
       " 'José María Chacón surrendered the island of Trinidad in 1797, one year before his death.',\n",
       " 'Liverpool F.C. was valued at $1.55 billion at one point.',\n",
       " 'Land Rover makes cars.',\n",
       " 'Sully is a form of media.',\n",
       " 'Stanley Tucci performed in an television series.',\n",
       " 'Stanley Tucci performed in an television series.',\n",
       " 'Brock Lesnar married Randy Couture.',\n",
       " 'The Khmer Empire was not weak.',\n",
       " 'On the Road (film) premiered at a film festival.',\n",
       " \"Paramore's co-founders left the band in March 2010.\",\n",
       " 'Peter Davison has been in a BBC show.',\n",
       " '21 Jump Street was released June 16, 2012.',\n",
       " 'The collections of the Philadelphia Museum of Art contain over 240,000 objects.',\n",
       " 'Dustin Hoffman is an award-winning actor.',\n",
       " 'T. J. Miller was featured in Deadpool 2.',\n",
       " 'Stephon Marbury plays basketball in America.',\n",
       " 'CP affects people.',\n",
       " 'Alfred Hitchcock is a person.',\n",
       " 'Julius Caesar is only a book.',\n",
       " 'Pulp Fiction is directed by a male.',\n",
       " 'Pulp Fiction is directed by a male.',\n",
       " 'Absolute Beginners was directed by Hitchcock.',\n",
       " 'No Reservations got a mixed reception from critics.',\n",
       " 'Claire Danes is wedded to an actor from England.',\n",
       " 'Claire Danes is wedded to an actor from England.',\n",
       " \"Dangerous Liaisons is based on Christopher Hampton's novel.\",\n",
       " 'The Academy Awards are an annual event.',\n",
       " 'The Academy Awards are an annual event.',\n",
       " 'Hubert Humphrey became the DFL candidate for mayor of a city.',\n",
       " 'Hubert Humphrey became the DFL candidate for mayor of a city.',\n",
       " 'Alex Rodriguez has 666 home runs.',\n",
       " 'Friendship has been studied in academic fields.',\n",
       " 'Judd Apatow is a person who writes.',\n",
       " 'Massachusetts is far away from Rhode Island.',\n",
       " 'Giancarlo Stanton was in the 2017 MLB draft.',\n",
       " 'Chris Pine appeared in Wonder Woman (2017 film).',\n",
       " 'Trevor Noah hosts a news satire show.',\n",
       " 'Lucas starred an actor that died on March 10.',\n",
       " 'Lucas starred an actor that died on March 10.',\n",
       " 'Ryan Phillippe refused to perform in the soap opera One Life to Live.',\n",
       " 'Sean Connery never won an Academy Award.',\n",
       " 'Venom has since become less of an antihero.',\n",
       " 'Overwatch is a video game in which players gain cosmetic awards and it assigns players into two teams of six, each player with a style of play known as Offense, Defense, Tank, and Support.',\n",
       " 'Lily James has been on TV.',\n",
       " 'Jing Tian date of birth is in July.',\n",
       " \"Jennifer Aniston's parents are Fred and Wilma Flintstone.\",\n",
       " 'The Peloponnesian War was won by Sparta.',\n",
       " 'Isis had a temple at Behbeit El Hagar.',\n",
       " 'International Relations only includes the entertainment industry.',\n",
       " 'Régine Chassagne is Canadian.',\n",
       " 'John McCain works in politics.',\n",
       " 'Farrah Fawcett received an Emmy Award nomination for her role as a battered wife in the 1984 film The Burning Bed.',\n",
       " 'The Who\\'s first single was \"My Generation\".',\n",
       " 'Planet of the Apes (1968 film) had a script that underwent rewrites.',\n",
       " 'Star vs. the Forces of Evil is a series.',\n",
       " 'Galaxy Quest is a movie that is American.',\n",
       " 'Friends with Benefits features actors.',\n",
       " 'Glenn Close won the Tony Award for Best Actress in a Play in 1984.',\n",
       " 'Glenn Close won the Tony Award for Best Actress in a Play in 1984.',\n",
       " 'Zooey Deschanel performed.',\n",
       " 'Seven Days in May stars an American.',\n",
       " 'Seven Days in May stars an American.',\n",
       " 'Seven Days in May stars an American.',\n",
       " 'Seven Days in May stars an American.',\n",
       " 'Winnipeg is home to several sports teams.',\n",
       " 'Mark Zuckerberg co-founded a website.',\n",
       " 'Mark Zuckerberg co-founded a website.',\n",
       " 'Rick and Morty was renewed for a fourth season in 2014.',\n",
       " 'Paul Walker acted in movies.',\n",
       " 'Clint Eastwood was nominated for an award.',\n",
       " 'Shonen Jump is published in a continent.',\n",
       " 'Shonen Jump is published in a continent.',\n",
       " 'Gilmore Girls is a Canadian show.',\n",
       " 'Honest sold 53,000 units in a week.',\n",
       " 'Since July 2012, Pranab Mukherjee has been in office.',\n",
       " 'Anonymous represents 4chan users simultaneously existing as an anarchic, digitized global brain.',\n",
       " 'San Francisco is in California.',\n",
       " 'Laadla is exclusively an American film.',\n",
       " 'Lily Collins wrote for a U.S magazine that targets teen girls.',\n",
       " 'Bangladesh has been affected by poverty.',\n",
       " 'Lisa Lopes was a founding member of TLC.',\n",
       " 'Lisa Lopes was a founding member of TLC.',\n",
       " 'The Formula (1980 film) was directed by an American.',\n",
       " 'The Formula (1980 film) was directed by an American.',\n",
       " \"Janet Jackson's third album was released in February 1986.\",\n",
       " \"Transformers: The Last Knight's cast includes Tyrese Gibson.\",\n",
       " 'There are two television series Morena Baccarin was part of.',\n",
       " 'There are two television series Morena Baccarin was part of.',\n",
       " 'There are two television series Morena Baccarin was part of.',\n",
       " 'There are two television series Morena Baccarin was part of.',\n",
       " 'Naturi Naughton was born in the year of 1984.',\n",
       " 'Paul Pogba has won four nonconsecutive Serie A titles.',\n",
       " \"Mel Gibson's name is Mel Colmcille Gerard Gibson.\",\n",
       " 'WALL-E is a Golden Globe Award winner.',\n",
       " 'Generation X has no precise date for its cohort.',\n",
       " 'Islam is incapable of being a religion.',\n",
       " 'Jackie Chan has released an album.',\n",
       " 'Estimates of the number of species on Earth today vary widely, and most of those species have not been described.',\n",
       " 'Larry Junstrom is an American citizen.',\n",
       " 'Canada possesses a constitution.',\n",
       " 'Canada possesses a constitution.',\n",
       " 'Sophie Turner acted in The Thirteenth Tale.',\n",
       " 'The Renaissance is known for its cultural developments.',\n",
       " 'Pluto is not relatively small.',\n",
       " 'Steve Buscemi has appeared in many films by the Coen Brothers, such as Fargo.',\n",
       " 'Tyler Joseph is an ex-member of Twenty One Pilots.',\n",
       " 'Selena Gomez has more followers than anyone else in the world.',\n",
       " 'Big Boi is only a member of Norwegian metal bands.',\n",
       " 'Big Boi is only a member of Norwegian metal bands.',\n",
       " \"Priyanka Chopra was born in the 1900's.\",\n",
       " 'Chris Pérez is a songwriter.',\n",
       " 'On March 27, 1963, Quentin Tarantino was born.',\n",
       " 'Tate Ellington appeared in Quantico.',\n",
       " 'Mr. Sunshine is from the Northern Hemisphere.',\n",
       " \"Dolly Parton isn't an actress.\",\n",
       " 'The Amanda Show was the first female-created show on Nickelodeon.',\n",
       " 'The 19th G7 summit only included Russia.',\n",
       " 'Ethiopia has bodies of water can be described as rivers.',\n",
       " 'Ted Kaczynski grew up in Texas.',\n",
       " 'Keith Urban has put out no fewer than nine studio records.',\n",
       " 'Eminem has an album.',\n",
       " 'The Connaught Tunnel was lined only with mud and sand.',\n",
       " 'Jennifer Aniston is not a businesswoman.',\n",
       " 'Ilkhanate only contained Haiti.',\n",
       " 'Homeland is based on the classic BBC series Til Death Do Us Part.',\n",
       " 'True Blood is a science-fiction television series.',\n",
       " 'Jordan Knight is the lead singer of a band.',\n",
       " 'Adam Driver has had supporting roles.',\n",
       " 'Thor: The Dark World is a movie.',\n",
       " 'Loki is the male sibling of Helblindi and Byleistr.',\n",
       " 'Vincent van Gogh is from Amsterdam.',\n",
       " 'Chester Bennington is a person.',\n",
       " 'Inspectah Deck is stateless.',\n",
       " 'Tender Mercies is a drama from America.',\n",
       " 'Cristiano Ronaldo was a professional athlete.',\n",
       " 'Paul Simon is a person.',\n",
       " 'Baby Driver starred Eiza González.',\n",
       " 'David Dhawan is a film director.',\n",
       " 'The Challenge was a reality game show.',\n",
       " \"Rumi's influence transcends ethnic divisions.\",\n",
       " 'Swedish Empire was ruled by Gustavus Adolphus from 1611 to 1632.',\n",
       " 'Swedish Empire was ruled by Gustavus Adolphus from 1611 to 1632.',\n",
       " 'Her was given a wide release on January 10, 2014.',\n",
       " \"Las Vegas's population has grown.\",\n",
       " 'One type of spread is Vegemite.',\n",
       " 'The Divergent film series was worked on by Octavia Spencer.',\n",
       " 'Ramayanam was produced by M. S. Reddy and directed by Gunasekhar.',\n",
       " 'Man of Steel features the DC Comics character Superman.',\n",
       " 'Leukemia has to do with a lack of normal blood cells.',\n",
       " 'Judy Garland did not appear in a courtroom drama film.',\n",
       " 'Judy Garland did not appear in a courtroom drama film.',\n",
       " 'Until Dawn is a game.',\n",
       " 'Timothy Olyphant was born.',\n",
       " 'Telangana contains the city Warangal.',\n",
       " 'Bonnie Hunt narrated Cheaper by the Dozen.',\n",
       " 'The Levant was ruled by the House of Lusignan.',\n",
       " 'The Ten Commandments influence multiple religions.',\n",
       " 'The Hangover Part III includes Bradley Cooper, Ed Helms, Zach Galifianakis, Justin Bartha, and Ken Jeong, Jeffrey Tambor, Heather Graham, Mike Epps, Melissa McCarthy and John Goodman.',\n",
       " \"Ariana Grande's second album debuted at number one in the United States when it was released in 2014.\",\n",
       " 'Ted Bundy committed assaults in the seventies.',\n",
       " 'Chinese people only can be associated with Spain through nationality.',\n",
       " \"Schindler's List was released in 1993.\",\n",
       " 'Zeus is an angel.',\n",
       " 'Zeus is an angel.',\n",
       " 'Escape from Planet Earth is an American film.',\n",
       " 'Venus Williams has won multiple Wimbledons.',\n",
       " 'Quentin Tarantino directed a creative work.',\n",
       " 'The Beatles had Stuart Sutcliffe initially serve as their agent.',\n",
       " '50 First Dates has no comedic elements.',\n",
       " 'A Nightmare on Elm Street was directed by Craven.',\n",
       " 'Charlize Theron acted in The Burning Plain.',\n",
       " 'Charlize Theron acted in The Burning Plain.',\n",
       " 'International Relations includes communication.',\n",
       " 'Jemaine Clement refuses to have anything to do with comedy.',\n",
       " 'Usain Bolt has competed in a sprint race in track and field in world competitions.',\n",
       " 'The main successor to the internet was the ARPANET.',\n",
       " 'Sarrainodu is an action movie.',\n",
       " 'Jawbreaker (film) stars an Italian-born American actress, film producer, director and singer.',\n",
       " 'Jawbreaker (film) stars an Italian-born American actress, film producer, director and singer.',\n",
       " 'Kurt Sutter is the creator of Sons of Anarchy.',\n",
       " 'La La Anthony has a middle name.',\n",
       " 'Lisa Marie Presley is an American singer.',\n",
       " 'Kingdom Hearts III is owned by Boyz II Men.',\n",
       " 'Kingdom Hearts III is owned by Boyz II Men.',\n",
       " 'Keanu Reeves is a film actor.',\n",
       " 'Dwayne Johnson won the WWF Intercontinental Championship twice.',\n",
       " 'Heartland is a canadian TV series.',\n",
       " 'By the metrics of the RIAA, The Beatles have sold more than any recording artist in America.',\n",
       " 'The national tree of Bangladesh is the mango.',\n",
       " 'There are two major contemporary political parties, and William Jennings Bryan belongs to one of them.',\n",
       " 'There are two major contemporary political parties, and William Jennings Bryan belongs to one of them.',\n",
       " 'Iris Murdoch was a writer.',\n",
       " 'David Koepp is a director.',\n",
       " 'A block is also called a \"swat.\"',\n",
       " 'Paul Pogba made it to the 2015 UEFA Champions League Final with the Juventus team.',\n",
       " 'Leroy Jethro Gibbs is a character on the NFL series NCIS.',\n",
       " 'Leslie Howard was an actor.',\n",
       " 'Catching Fire is written.',\n",
       " 'Avatar: The Last Airbender aired on Nickelodeon.',\n",
       " \"Harry Hopman's widow has attended Hopman Cup.\",\n",
       " \"Frank Zappa's debut was Freak Out!\",\n",
       " 'Ruth Negga only acts in Irish cinema.',\n",
       " 'Ruth Negga only acts in Irish cinema.',\n",
       " 'George VI was succeeded by Mary I.',\n",
       " 'Psychological findings link to research and perspectives from an academic discipline.',\n",
       " 'Psychological findings link to research and perspectives from an academic discipline.',\n",
       " 'The Beach Boys was an American rock band.',\n",
       " 'Billy Bob Thornton directed a movie.',\n",
       " 'The Ren & Stimpy Show premiered on August 11, 1991.',\n",
       " 'Courteney Cox has always refused to play Gale Weathers.',\n",
       " 'Ronin is a film.',\n",
       " 'Abraham Lincoln had at least one rival.',\n",
       " 'There is a producer named Fred Savage.',\n",
       " 'Al Capone had neurosyphilis.',\n",
       " 'Al Capone had neurosyphilis.',\n",
       " 'Boston is located in the state of Massachusetts on the Shawmut Peninsula.',\n",
       " 'Boston is located in the state of Massachusetts on the Shawmut Peninsula.',\n",
       " 'Interstellar is a narrative in a visual medium.',\n",
       " 'Britney Spears titled her fourth studio album Britney.',\n",
       " 'Mike Tyson boxed.',\n",
       " 'The Hermetic Order of the Golden Dawn was uninterested in the study of the occult.',\n",
       " 'Ellen Burstyn has yet to be nominated for the Emmy Awards.',\n",
       " 'Princess Agents is a series on television.',\n",
       " 'Gwen Stefani works as a singer.',\n",
       " 'James Marsden worked with a director.',\n",
       " 'James Marsden worked with a director.',\n",
       " 'Carrie Fisher died of cardiac arrest.',\n",
       " 'Ice hockey has competitions.',\n",
       " 'The Fifth Element was the lowest-grossing French film in the international box office until 2011.',\n",
       " 'The Hunger Games is the first in Lord of the Rings series.',\n",
       " 'Audi used to have the pet \"Truth in Engineering.\"',\n",
       " 'Java contains more than half of the population of Indonesia.',\n",
       " 'Urilla Sutherland Earp was the first spouse of Wyatt Earp.',\n",
       " 'Brave is a 2010s film.',\n",
       " 'Winter Passing had mixed reviews in 2005.',\n",
       " 'Audrey Horne was introduced in anything except a series that premiered on Sunday.',\n",
       " 'Audrey Horne was introduced in anything except a series that premiered on Sunday.',\n",
       " 'Line of Duty is a TV series.',\n",
       " 'The Dayton Agreement was signed in April.',\n",
       " 'The National Security Agency is tasked with the processing of data for counterintelligence purposes.',\n",
       " 'Gold is resistant to all acids except aqua regia.',\n",
       " 'There is a geologic period that spans 43 million years called Paleogene.',\n",
       " 'Cher has sold more than 100 million music records worldwide.',\n",
       " 'Bernard Madoff got the sentence.',\n",
       " 'Donkey is a fast-talking donkey.',\n",
       " 'O. J. Simpson received a criminal charge for armed robbery.',\n",
       " 'Ketogenic diet has protein.',\n",
       " 'Dennis Quaid refused to ever be an actor.',\n",
       " 'The United States was the first country to develop nuclear weapons.',\n",
       " 'Thandie Newton is incapable of appearing in British films.',\n",
       " \"Reese Witherspoon's breakthrough role was in a film.\",\n",
       " 'Jenni Rivera was only nominated for an award presented annually by American network Univision.',\n",
       " 'Jenni Rivera was only nominated for an award presented annually by American network Univision.',\n",
       " 'Curly Top was released.',\n",
       " 'Edgar Allan Poe was a horse.',\n",
       " 'Danny DeVito received an Academy Award nomination.',\n",
       " 'PageRank was named after someone.',\n",
       " 'Morena Baccarin received a nomination.',\n",
       " 'Jeffrey Dahmer committed murders in Wisconsin.',\n",
       " 'Naomi Scott played Darth Maul in Lemonade Mouth.',\n",
       " 'The Minnesota Vikings is a National Football League team.',\n",
       " 'L.A. Law is a television series that categorizes as a legal drama.',\n",
       " 'Paradise was released in 2012.',\n",
       " 'Dirt was produced by ABC studios and Coquette Productions.',\n",
       " 'Arsenic and Old Lace had its release delayed by 3 months.',\n",
       " 'The Belko Experiment is an American horror film released in 2016.',\n",
       " 'Psychology has been disqualified from being a social science.',\n",
       " 'Apple was founded in 1979.',\n",
       " 'Moscow is a city in Russia.',\n",
       " 'The term cult film was first used in the 1970s.',\n",
       " 'The September 11 attacks caused at least $10 billion in property damage.',\n",
       " \"The second longest of Shakespeare's plays after Hamlet is Richard III.\",\n",
       " 'Kathy Bates was born on June 28, 1948.',\n",
       " 'Joseph Barbera was an American director.',\n",
       " 'Penny Dreadful started in 2017.',\n",
       " 'There is a video game called Overwatch (video game).',\n",
       " 'The Lion King was released before 2000.',\n",
       " 'Before We Go was previously titled Fury.',\n",
       " 'Stevie Nicks released an album that reached platinum status.',\n",
       " \"Overwatch's playable characters are categorized into four groups.\",\n",
       " 'Andrew Wood died in 1977.',\n",
       " 'James McAvoy starred in Children of Dune.',\n",
       " 'John Constantine is a real person.',\n",
       " \"The Portuguese Empire was one of world history's largest empires.\",\n",
       " 'Eddie Vedder is a performer.',\n",
       " 'Kenny Rogers released the album, Kenny in 2005.',\n",
       " 'Kenny Rogers released the album, Kenny in 2005.',\n",
       " 'Larry Buttrose wrote Cafe Royale.',\n",
       " 'Elementary stars Lucy Liu.',\n",
       " 'Elementary stars Lucy Liu.',\n",
       " 'Farrah Fawcett acted in the romantic comedy Love is a Funny Thing.',\n",
       " 'X-Men: Days of Future Past is based on the DC Batman comics.',\n",
       " 'San Junipero is from Britain.',\n",
       " 'Alex Rodriguez never hit a home run.',\n",
       " 'John F. Kennedy ran against Andrew Jackson in the 1960 presidential election.',\n",
       " 'Gift of the Night Fury only stars the voices of actors and actresses born in October.',\n",
       " 'Gift of the Night Fury only stars the voices of actors and actresses born in October.',\n",
       " \"Schindler's List was not awarded The Academy Award for Best Picture.\",\n",
       " 'Juana la virgen is a telenovela written by Perla Farias.',\n",
       " 'The Champ stars an American.',\n",
       " 'Monarch of the Glen is a drama from Britain.',\n",
       " 'Robert Redford is a film director.',\n",
       " 'Best Director was a nomination Beasts of the Southern Wild received.',\n",
       " 'The Los Angeles Lakers hold the NBA record for longest winning streak.',\n",
       " 'The Philippines is industrial.',\n",
       " 'Joe Manganiello has appeared in a movie.',\n",
       " 'Veronika Decides to Die is authored by Roberta Hanley.',\n",
       " 'Sully is a Tom Hanks movie.',\n",
       " 'Walter Matthau is incapable of winning anything.',\n",
       " 'Lisa Kudrow appeared on Showtime.',\n",
       " 'Myles Kennedy has released albums.',\n",
       " 'Jane Fonda worked with Lily Tomlin in a show.',\n",
       " 'Imagine Dragons was named the \"Breakthrough Band of 2014.\"',\n",
       " 'Mike Love co-founded a band.',\n",
       " 'Apple was incorporated as Apple Computer, Inc. in January 1977.',\n",
       " 'Star Search was relaunched in 2003-04.',\n",
       " 'Canada was never the location of a French colony.',\n",
       " 'System of a Down has only sold albums in Greenland.',\n",
       " 'Led Zeppelin was first named the New Yardbirds.',\n",
       " 'Payton Manning signed with the Ontario Broncos.',\n",
       " 'Anthropology is a division of Davis Entertainment.',\n",
       " 'Kafka stars an actor.',\n",
       " 'Kafka stars an actor.',\n",
       " 'Alex Rodriguez played for the Mariners.',\n",
       " 'Charles Marie de La Condamine was born in 1701.',\n",
       " 'Pulp Fiction is written by a man.',\n",
       " 'Pulp Fiction is written by a man.',\n",
       " 'Giada De Laurentiis has been a contributor to a morning TV program.',\n",
       " 'Giada De Laurentiis has been a contributor to a morning TV program.',\n",
       " 'The Grammy Hall of Fame inducted Bohemian Rhapsody.',\n",
       " 'Hugh Jackman has a public feud with Christopher Nolan, preventing any collaboration between the two.',\n",
       " 'Hugh Jackman has a public feud with Christopher Nolan, preventing any collaboration between the two.',\n",
       " 'Cate Blanchett was nominated for an Academy Award.',\n",
       " 'Slash was born in 1965.',\n",
       " 'Drake is only German.',\n",
       " 'R. Madhavan was a cast member of 3 Idiots.',\n",
       " 'James and the Giant Peach includes Richard Dreyfuss.',\n",
       " 'Ayn Rand condemned force.',\n",
       " 'Anne Hathaway had a part in Ella Enchanted.',\n",
       " 'Oh Yeon-seo was born.',\n",
       " 'Ben Stiller was involved in the film industry in the 1990s.',\n",
       " 'Ben Stiller was involved in the film industry in the 1990s.',\n",
       " 'The Los Angeles Lakers were nicknamed \"Showtime\" in the 1980s.',\n",
       " 'Slovenia is bordered by the Adriatic Sea.',\n",
       " 'Italy is officially called the big meatball.',\n",
       " 'Ron Cobb was only born in the year 1954.',\n",
       " 'Just Dance was a song.',\n",
       " 'Journey is a band.',\n",
       " 'Life Is Peachy was released by Epic Records.',\n",
       " 'Sarah Silverman never wrote for a sketch comedy show.',\n",
       " 'Sarah Silverman never wrote for a sketch comedy show.',\n",
       " 'A mole is a structure.',\n",
       " 'Shahid Kapoor supports charities.',\n",
       " 'Doctor Who was written by the Ancient Greeks.',\n",
       " 'Doctor Who was written by the Ancient Greeks.',\n",
       " 'L.A. Law ended on May 19, 1994.',\n",
       " 'Jerry Seinfeld specialized in observational comedy.',\n",
       " 'Marie Curie was naturalized-German.',\n",
       " 'Honey to the B was the first album of a singer and actress from England.',\n",
       " 'Honey to the B was the first album of a singer and actress from England.',\n",
       " 'Will Ferrell is considered to be part of the Frat Pack.',\n",
       " 'Donnie Wahlberg acts with Tom Selleck.',\n",
       " 'Rogue appears in Canadian comic books.',\n",
       " 'The German Shepherd is the second-most registered breed by the American Kennel Club and The Kennel Club UK.',\n",
       " 'Diego Costa was born in October.',\n",
       " \"Ocean's Eight is a sequel to the Ocean's Trilogy.\",\n",
       " 'The United Kingdom includes Scotland.',\n",
       " 'John Wick: Chapter 2 is a film.',\n",
       " 'Europe is the location of Andorra.',\n",
       " 'Axl Rose has been named one of the greatest singers.',\n",
       " 'Steffi Graf won 5 consecutive majors.',\n",
       " 'Jennifer Garner had a starring role in the film Catch Me if You Can.',\n",
       " 'Boromir is mentioned in the third and last volume of The Lord of the Rings.',\n",
       " 'Boromir is mentioned in the third and last volume of The Lord of the Rings.',\n",
       " 'Paul Simon is an actor.',\n",
       " 'Game of Thrones (season 3) is a drama set in a fantasy world.',\n",
       " 'Game of Thrones (season 3) is a drama set in a fantasy world.',\n",
       " \"Taiwan's high-tech industry plays a key role in the local economy.\",\n",
       " 'London has an elected official.',\n",
       " 'London has an elected official.',\n",
       " 'Bill Gates was the largest individual shareholder of Microsoft.',\n",
       " 'The phalanx may be deployed for killing.',\n",
       " 'Robbie Collin edited The Saint.',\n",
       " 'Christianity failed to spread to Australasia.',\n",
       " 'Feels So Good was written for the album Hot.',\n",
       " 'Deadpool is not part of a film series.',\n",
       " 'Evolution was by someone born in May.',\n",
       " 'Evolution was by someone born in May.',\n",
       " 'Kmart has stores in operation in an unincorporated and organized territory of the United States.',\n",
       " 'Kmart has stores in operation in an unincorporated and organized territory of the United States.',\n",
       " 'Ancient Algeria has known many empires and dynasties, including ancient Carthaginians.',\n",
       " 'Clint Eastwood has been in films.',\n",
       " 'Gorgeous Ladies of Wrestling is a wrestling promotion for women.',\n",
       " 'Gustave Eiffel made significant contributions to aerodynamics.',\n",
       " 'Idris Elba has been nominated four times for a Golden Globe Award in acting.',\n",
       " 'Paul Rudd passed up the role he was offered in Role Models.',\n",
       " 'The Twelfth Doctor is capable of superhuman abilities.',\n",
       " 'Happy Endings had Lisa Kudrow in it.',\n",
       " \"Grace VanderWaal won the NBC TV competition show America's Got Talent.\",\n",
       " 'Jennifer Hudson has won a Grammy.',\n",
       " 'Marie Antoinette died in 1793.',\n",
       " 'The Uruguay national football team won two FIFA World Cups.',\n",
       " 'Overwatch is a board game.',\n",
       " 'The Sopranos is a televised show.',\n",
       " 'Babe Ruth was active in Major League Baseball from 1914-1935.',\n",
       " 'Roger Federer plays a racket sport.',\n",
       " 'Roger Federer plays a racket sport.',\n",
       " 'La La Anthony was in November Rule and Destined.',\n",
       " 'The United States Naval Academy is in Maryland.',\n",
       " 'Tom Welling was born November 26, 1977.',\n",
       " 'In the Heart of the Sea was released in cinemas.',\n",
       " 'Blues and rock music has been played by the band AC/DC.',\n",
       " 'Naruto is incapable of being a ninja.',\n",
       " 'Marilyn Monroe is an actress.',\n",
       " 'Wyatt Earp was a constable and he was American.',\n",
       " 'Israel hosts a population of asylum seekers including illegal migrants from Sudan.',\n",
       " 'The American Broadcasting Company has a nickname.',\n",
       " 'Cindy McCain is married to a 2008 rugby champion.',\n",
       " 'Leonardo DiCaprio is a fish.',\n",
       " 'T-Pain is the founder of a record label imprint established in 2005.',\n",
       " 'Beyoncé was given a music award.',\n",
       " 'Alan Ladd failed to become television producer.',\n",
       " 'VHS was released in late 1976 in Japan.',\n",
       " 'Pixar was funded by an Indian industrial designer.',\n",
       " 'Pixar was funded by an Indian industrial designer.',\n",
       " 'The Chernobyl disaster ultimately involved more than 500,000 workers.',\n",
       " 'Frédéric Auguste Bartholdi was a painter.',\n",
       " 'The Beatles were formed in London.',\n",
       " 'The Beatles were formed in London.',\n",
       " 'Kumail Nanjiani has declined to act in any movies.',\n",
       " 'Hacksaw Ridge made money.',\n",
       " 'In 2010, Kick-Ass was released.',\n",
       " 'Harry Potter confronts someone in Harry Potter and the Deathly Hallows.',\n",
       " 'Sophie Turner appeared in movies in 2013.',\n",
       " 'Farrah Fawcett was the subject of an NBC documentary.',\n",
       " 'Tiger Woods has not competed in a golf tournament.',\n",
       " 'Brian Eno was born in England.',\n",
       " 'Brian Eno was born in England.',\n",
       " 'Portugal does not share a border with Spain.',\n",
       " 'Steven Knight was born in 1959.',\n",
       " 'Suits is a show about lawyers.',\n",
       " 'Tom Hanks has been granted at least three awards.',\n",
       " 'Dwyane Wade was rejected for the All-Rookie team.',\n",
       " 'The Homesman features American actor John Lithgow.',\n",
       " \"Star Wars' soundtrack was recorded in England.\",\n",
       " 'The cast of The Playboy Club includes Leah Renee.',\n",
       " 'The Portuguese Empire was an empire in world history.',\n",
       " \"Chris Froome's parents are people.\",\n",
       " 'Shueisha is a publisher headquartered in Maine.',\n",
       " 'Friendship has been studied in academic disciplines like anthropology.',\n",
       " 'Belgium is comprised of three regions.',\n",
       " \"Apple Inc.'s consumer software lacks the iOS operating system.\",\n",
       " 'Kris Wu starred in a Chinese film called Journey to the West.',\n",
       " 'Super Metroid is a movie sequel.',\n",
       " 'One America News Network is abbreviated as OANN.',\n",
       " 'Jennifer Garner is a board member of Save the Children.',\n",
       " 'The Portuguese Empire existed during the Renaissance.',\n",
       " 'One actor is Scott Eastwood.',\n",
       " 'Tall Story is a romantic comedy club.',\n",
       " 'X-Men: Days of Future Past is a novel based on X-Men characters in comics.',\n",
       " 'Richard Eyre is a television director.',\n",
       " 'Furious 7 began principal photography in the summer of 2013.',\n",
       " 'Prakash Jha is an actor.',\n",
       " 'Splatoon 2 is the only game in its franchise.',\n",
       " 'Nepal was ruled by the Shah dynasty until 2008.',\n",
       " 'Nepal was ruled by the Shah dynasty until 2008.',\n",
       " 'The interior of Uranus is only composed of gas.',\n",
       " 'Sriti Jha plays the lead role in a TV show.',\n",
       " 'There is a film called Absolute Beginners.',\n",
       " 'Qatar borders London.',\n",
       " 'Qatar borders London.',\n",
       " 'The Amanda Show aired from 1999 to 2002.',\n",
       " 'Brock Lesnar is signed to a Japanese mixed martial arts promotion.',\n",
       " 'The Hangover Part III includes Justin Bartha.',\n",
       " 'Lee Harvey Oswald assassinated the 35th President of the United States.',\n",
       " 'Lee Harvey Oswald assassinated the 35th President of the United States.',\n",
       " 'In & Out is directed by James Cameron.',\n",
       " 'Tom Felton is a person.',\n",
       " 'Louis Tomlinson appeared in a TV drama.',\n",
       " 'Louis Tomlinson appeared in a TV drama.',\n",
       " 'Louis Tomlinson appeared in a TV drama.',\n",
       " 'Kalpana Raghavendar is an artist.',\n",
       " 'Luke Evans had his Hollywood breakthrough role starring in a play.',\n",
       " 'Luke Evans had his Hollywood breakthrough role starring in a play.',\n",
       " 'Emily Ratajkowski was visible in the \"Blurred Lines\" music video.',\n",
       " '10 Cloverfield Lane stars the actor John Gallagher, Jr.',\n",
       " 'Chris Froome rides under a British license.',\n",
       " 'Olivia Munn failed to be credited as Lisa Munn.',\n",
       " 'Batman is yet to be released.',\n",
       " 'Marlon Brando is an actor who was in Mutiny on the Bounty.',\n",
       " \"None of lung cancer's symptoms is chest pains.\",\n",
       " 'Iran has 21 UNESCO World Heritage Sites.',\n",
       " 'The Taj Mahal attracts significantly less than 7-8 million visitors a year.',\n",
       " 'Lisbon is in Portugal.',\n",
       " 'Arya Stark is the daughter of Lady Catelyn Stark.',\n",
       " 'Selene serves as the central character in a film written by Danny McBride in 2001.',\n",
       " 'Selene serves as the central character in a film written by Danny McBride in 2001.',\n",
       " 'Pulp Fiction is an American black comedy neo-noir film released in 1994.',\n",
       " 'Dan Aykroyd has received zero Academy Award nominations.',\n",
       " 'Dhool was directed by Dharani.',\n",
       " 'Watchmen was number 91 on The Comics Journals list of the top 100 comics of the 20th century that was published in 2001.',\n",
       " 'Watchmen was number 91 on The Comics Journals list of the top 100 comics of the 20th century that was published in 2001.',\n",
       " 'Android has had prosperity.',\n",
       " 'Saddam Hussein died in 1937.',\n",
       " 'Tim Rice has collaborated with someone.',\n",
       " 'Hugo Weaving is in zero movies.',\n",
       " 'Time Lords have time machines.',\n",
       " 'Arsenic and Old Lace was released in 1964.',\n",
       " 'The Catalyst is a rock song.',\n",
       " 'Indiana Jones has been portrayed by Corey Carrier.',\n",
       " 'Umbrella is a single.',\n",
       " 'Sandra Bullock stars in The Proposal.',\n",
       " 'Martin Luther King Jr. worked on segregated housing in earnest.',\n",
       " 'FC Barcelona was awarded five trophies.',\n",
       " 'The Great Buck Howard was directed by Ingmar Bergman.',\n",
       " 'John McEnroe is famous for his aggressive behavior on the court.',\n",
       " \"John Mayer's first EP was released while he was signed to Columbia Records.\",\n",
       " 'Dirty Diana is by Michael Jackson.',\n",
       " \"American Gods' adaptation began airing.\",\n",
       " 'Adrienne Bailon is an American actress.',\n",
       " 'Marlon Brando was in any movie but Julius Caesar.',\n",
       " 'Up All Night was released by Syco Records in 2011.',\n",
       " 'Little Miss Sunshine was filmed over 30 days beginning on June 6, 2005.',\n",
       " 'IO Theater is a place where people train.',\n",
       " 'Coke Boys Records was founded by an American Rapper.',\n",
       " 'John McCain was a presidential nominee in 2008.',\n",
       " 'John McCain was a presidential nominee in 2008.',\n",
       " 'Gia is a work.',\n",
       " '21 Jump Street was released by Columbia Pictures in 2002.',\n",
       " 'Kuala Lumpur has the Petronas Twin Towers.',\n",
       " 'The television series Fargo has an anthology format, setting each season in a different era with a different story and cast.',\n",
       " 'An annual training camp is hosted by the Carolina Panthers.',\n",
       " 'Ronaldo Maczinski is Irish.',\n",
       " 'Born This Way is a piece of music.',\n",
       " 'By 1997, Andre Agassi was number 141 in the world.',\n",
       " 'Charles, Prince of Wales was a grandchild of a king.',\n",
       " 'Man of Steel is a superhero movie from 2013.',\n",
       " 'Kate Beckinsale was directed by James Ivory.',\n",
       " 'Kate Beckinsale was directed by James Ivory.',\n",
       " 'Shakira is a performer.',\n",
       " 'Michael Schumacher is a professional writer',\n",
       " 'Bridget Moynahan was cut from Lord of War.',\n",
       " 'There is a mosque in the Taj Mahal.',\n",
       " \"Cry Freedom wasn't shot in Kenya.\",\n",
       " 'In the United States presidential election of 1972, Richard Nixon was a candidate.',\n",
       " 'There is a cultural attraction called the Museum of Science and Industry.',\n",
       " 'Carrie Fisher wrote a book.',\n",
       " 'Anil Kapoor has never been a producer.',\n",
       " 'Adolf Hitler encouraged settler colonialism.',\n",
       " 'Adolf Hitler encouraged settler colonialism.',\n",
       " 'Before Night Falls is a film.',\n",
       " 'An example of a Christmas comedy film is Home Alone.',\n",
       " 'Steven Price (composer) worked on the film Gravity.',\n",
       " 'The 1991 NBA Finals had the Lakers in it.',\n",
       " 'Google has been the second most valuable brand in the world for 4 blue years.',\n",
       " 'Instagram is a photo-sharing application.',\n",
       " 'Snooki & Jwoww was renewed by at least one channel.',\n",
       " 'Snooki & Jwoww was renewed by at least one channel.',\n",
       " 'The Eagles broke up in 1980.',\n",
       " 'Black Widow is Russian.',\n",
       " 'Portugal is the 5th most peaceful country in the world and it also features a high-income advanced economy and the 18th highest social progress in the world.',\n",
       " 'A temperate seasonal climate influences Berlin.',\n",
       " 'Twitter had about 1.6 billion search queries per day in 2012.',\n",
       " 'Ramadan is the ninth calendar month in Islam.',\n",
       " 'The self-empowerment of the LGBT community is discussed in Born This Way.',\n",
       " 'Mao Zedong lived until 1976.',\n",
       " 'The Hangover Part III includes Bradley Cooper, Ed Helms, Zach Galifianakis, Justin Bartha, and Ken Jeong, Jeffrey Tambor, Heather Graham, Mike Epps, Melissa McCarthy and John Goodman.',\n",
       " 'Steven Tyler was active in the early 1980s.',\n",
       " 'Wikipedia has articles in only english.',\n",
       " 'Ellyse Perry is a man.',\n",
       " 'American Idiot has not had five successful singles.',\n",
       " 'Wyatt Earp was an actor.',\n",
       " 'Toronto is the least populous city in Canada.',\n",
       " 'Toronto is the least populous city in Canada.',\n",
       " \"Paul is Steve Jobs' middle name.\",\n",
       " 'Destiny was released for the console Playstation 4.',\n",
       " \"Heather Graham played the title character in the series Emily's Reasons Why Not in 2010.\",\n",
       " 'Battle Studies World Tour was a global tour.',\n",
       " 'Samuel L. Jackson was in the M. Night Shyamalan film Unbreakable.',\n",
       " 'Singapore is south of Indonesia.',\n",
       " 'Jennifer Hudson was a finalist of American Idol.',\n",
       " \"Hong Kong is incapable of being consistently ranked as the world's most freest economic entity.\",\n",
       " 'Manchester City F.C. was bought by the Abu Dhabi United Group.',\n",
       " 'Unapologetic is a work.',\n",
       " 'Andre Agassi is a golfer.',\n",
       " 'Liverpool F.C. was managed by Bill Shankly.',\n",
       " 'Liverpool F.C. was managed by Bill Shankly.',\n",
       " 'Bangladesh is a founding member of nationalism.',\n",
       " 'Jon Pertwee took part in Worzel Gummidge.',\n",
       " 'Lee Child was born on October 29.',\n",
       " 'Tequila is incapable of being made in Mexico.',\n",
       " 'Michael Phelps holds three long course world records for swimming.',\n",
       " 'Donald Glover never released an album.',\n",
       " 'FC Barcelona was ranked second in the IFFHS Club World Ranking for 2015.',\n",
       " 'Courteney Cox appeared on a show created by David Crane and Marta Kauffman.',\n",
       " 'Courteney Cox appeared on a show created by David Crane and Marta Kauffman.',\n",
       " 'Chris Pine appeared in a 2012 American romantic comedy spy film.',\n",
       " 'Chris Pine appeared in a 2012 American romantic comedy spy film.',\n",
       " 'Ratatouille was directed by one person.',\n",
       " 'Kurt Angle won a gold medal in freestyle wrestling at the 1995 World Wrestling Championships.',\n",
       " 'Iron Fist was created by Damon Lindelof.',\n",
       " 'Dangerous Beauty is a 1990 film.',\n",
       " 'The Avengers (2012 film) features Chris Evans.',\n",
       " 'Jerry Goldsmith failed to collaborate with anybody during his career.',\n",
       " \"Charles, Prince of Wales sponsors The Prince's Charities.\",\n",
       " 'Grizz Chapman was on 30 Rock.',\n",
       " 'Nicki Minaj is a person.',\n",
       " 'Margaret of Valois was imprisoned.',\n",
       " 'The Dayton Agreement was formally signed in Paris in 1995.',\n",
       " 'As the World Turns went away and an American talk show debuted on October 18, 2010 in its place.',\n",
       " 'Princess Agents is a novel adaptation.',\n",
       " 'The Vampire Diaries only aired two seasons.',\n",
       " 'The Ten Commandments is reviewed by Cecil B. DeMille.',\n",
       " \"The Bends was released in the 1990's.\",\n",
       " 'Alandi is only a city.',\n",
       " 'A singer in Got a Girl starred in Final Destination 3.',\n",
       " 'A singer in Got a Girl starred in Final Destination 3.',\n",
       " 'Peggy Sue Got Married was directed by an American director.',\n",
       " 'Role Models is a film.',\n",
       " 'Gerald Ford was the United States president after Richard Nixon.',\n",
       " 'Will Ferrell worked on a film.',\n",
       " 'Marshall McLuhan predicted his own death.',\n",
       " 'Walt Disney founded a company.',\n",
       " 'Brock Lesnar won against Randy Couture.',\n",
       " 'Guam was employed by America.',\n",
       " 'Sweden is a Scandinavian country.',\n",
       " \"One of Future's studio albums was published in 2017.\",\n",
       " \"One of Future's studio albums was published in 2017.\",\n",
       " 'David Dhawan is a director of films.',\n",
       " 'This Sporting Life was directed by a director born in 1919.',\n",
       " 'This Sporting Life was directed by a director born in 1919.',\n",
       " 'International Relations includes technology and engineering, economics, communication studies, history, international law, demography, philosophy, geography, social work, sociology, anthropology, criminology, psychology, gender studies, cultural studies, culturology, and diplomacy, globalization, diplomatic relations, state sovereignty, international security, ecological sustainability, nuclear proliferation, nationalism, economic development, global finance, as well as terrorism and organized crime, human security, foreign interventionism, and human rights, as well, as, more recently, comparative religion.',\n",
       " \"Underworld's main character is a supernatural creature.\",\n",
       " 'Avenged Sevenfold released an album.',\n",
       " 'Brock Lesnar defeated someone.',\n",
       " 'Three Days of the Condor includes a Swedish actor.',\n",
       " 'Three Days of the Condor includes a Swedish actor.',\n",
       " \"Tyra Banks presented America's Got Talent.\",\n",
       " \"Tyra Banks presented America's Got Talent.\",\n",
       " 'Romelu Lukaku is a golfer.',\n",
       " 'Toy Story is a movie of the buddy comedy adventure genres.',\n",
       " 'Al Capone was not prosecuted for tax evasion.',\n",
       " 'Chet Atkins produced records for Dolly Parton.',\n",
       " 'Trevor Baxter went to college at Dulwich College.',\n",
       " 'A Song of Ice and Fire is part of an American book series called A Game of Thrones.',\n",
       " 'Many voice actors act in Timon & Pumbaa.',\n",
       " 'Jeff Bridges played a role in an American Revisionist Western film.',\n",
       " 'Jeff Bridges played a role in an American Revisionist Western film.',\n",
       " 'Zach Galifianakis starred in a film.',\n",
       " 'Nigeria is one of the countries in the Next Eleven.',\n",
       " 'Nigeria is one of the countries in the Next Eleven.',\n",
       " 'Angela Lansbury got significant recognition for her acting performance in The Manchurian Candidate.',\n",
       " 'Murray was played by Keegan-Michael Key in Hotel Transylvania 2.',\n",
       " 'Born Naked is an album.',\n",
       " 'Rock music incorporated music genres like a type of blues music distinguished by the use of electric amplification for musical instruments known as electric blues.',\n",
       " 'Rock music incorporated music genres like a type of blues music distinguished by the use of electric amplification for musical instruments known as electric blues.',\n",
       " 'Reba McEntire sang on radio shows.',\n",
       " 'The Constitution of Medina was written by Muhammad.',\n",
       " 'The Constitution of Medina was written by Muhammad.',\n",
       " 'Sleep can be disrupted by medical conditions.',\n",
       " 'Frank is by a person.',\n",
       " 'A German-American fashion model starred in The Host.',\n",
       " 'A German-American fashion model starred in The Host.',\n",
       " 'Robert Redford guest starred on Perry Mason.',\n",
       " 'Katie Stevens is Australian.',\n",
       " 'Haiti is a member of the World Trade Organization.',\n",
       " 'Anne Hathaway debuted in the Fox television series Get Real.',\n",
       " 'Twitter has more than one office.',\n",
       " 'Venus Williams has won a tournament.',\n",
       " 'Red is inspired by a comic book series.',\n",
       " 'J. Cole is a hip hop recording artist.',\n",
       " 'The cast of The Playboy Club includes David Krumholtz.',\n",
       " 'Portugal maintains a unitary semi-presidential republican form of government which means that the president exists alongside the prime minister and the cabinet and the central government is supreme.',\n",
       " 'Portugal maintains a unitary semi-presidential republican form of government which means that the president exists alongside the prime minister and the cabinet and the central government is supreme.',\n",
       " 'Randy Orton is a squid.',\n",
       " 'Rainn Wilson graduated in the 80s.',\n",
       " 'Zeus is the child of Cronus and Rhea.',\n",
       " 'Matt Kuchar is a professional golf player.',\n",
       " 'Burundi is only populated by Tutsis.',\n",
       " 'Foo Fighters was created by a name reported by aircraft pilots.',\n",
       " 'Nickelodeon has weekday programs.',\n",
       " 'Arrested Development won six Primetime Emmy Awards.',\n",
       " 'Jim Carrey has worked with director Don Scardino.',\n",
       " 'Jim Carrey has worked with director Don Scardino.',\n",
       " 'Eminem only performs alone.',\n",
       " 'David Thewlis has performed.',\n",
       " 'In 1968, Led Zeppelin formed.',\n",
       " 'Dwyane Wade played for Chicago.',\n",
       " 'Champion was based off of a Ring Lardner story.',\n",
       " \"My Bloody Valentine 3D's editor was Patrick Lussier.\",\n",
       " 'Dwight Schrute was based on Gareth Keenan.',\n",
       " 'Beasts of the Southern Wild was nominated for an award.',\n",
       " 'Transformers (film) is based on a toy line created by Hasbro.',\n",
       " \"Laura Prepon portrayed Donna Pinciotti in That '70s Show.\",\n",
       " 'Charles Dickens was not English.',\n",
       " 'Michael Fassbender was in the NBC miniseries Band of Brothers.',\n",
       " 'Keeping Up with the Joneses had a budget.',\n",
       " 'RenderMan was developed by Pixar.',\n",
       " 'The Homesman features at least one American actor.',\n",
       " 'Peter Cetera was an artist.',\n",
       " 'Heartbreak Ridge was filmed in Technicolor.',\n",
       " 'Cape Fear features a cameo from Robert Mitchum and it is directed by Martin Scorsese.',\n",
       " 'Oliver Reed was in a movie.',\n",
       " 'Oliver Reed was in a movie.',\n",
       " 'Maggie Smith is an actress.',\n",
       " 'Jackie Robinson died in the seventies.',\n",
       " \"Eric Trump's father's birthday is June 14.\",\n",
       " \"Eric Trump's father's birthday is June 14.\",\n",
       " 'Ethiopia is a state.',\n",
       " 'On February 18, 1949, Gary Ridgway was born.',\n",
       " 'Eva Longoria has starred in Harsh Times.',\n",
       " 'Angela Lansbury was born to a family that was upper-middle-class.',\n",
       " 'The World Science Festival is produced by the World Science Foundation.',\n",
       " 'XXx: Return of Xander Cage has the writer F. Scott Frazier.',\n",
       " 'Kid Rock is an artist.',\n",
       " 'Hillary Clinton was employed in the Obama administration.',\n",
       " 'The Ten Commandments (1956 film) is a 1956 American movie.',\n",
       " 'Kangana Ranaut was alive.',\n",
       " 'Marlon Brando took part in a film adapted from the work of a writer of more than 40 books.',\n",
       " 'Marlon Brando took part in a film adapted from the work of a writer of more than 40 books.',\n",
       " 'Ringo Starr replaced Pete Best.',\n",
       " 'Oscar Robertson is American.',\n",
       " 'Wyoming is the least populous state in the United States.',\n",
       " 'Heartland has no nationality.',\n",
       " 'Following was only directed by Martin Scorsese.',\n",
       " 'Jacinda Barrett is a person.',\n",
       " \"Ubisoft created Assassin's Creed.\",\n",
       " 'Edgar Award honors the best in TV.',\n",
       " 'Lewis Hamilton is a race car driver.',\n",
       " \"Girls' Generation features Taeyeon.\",\n",
       " 'Pirates of the Caribbean is set in a fictional future setting.',\n",
       " 'Ad-Rock is single.',\n",
       " 'Gianluigi Buffon has been named Serie A Goalkeeper of the Year.',\n",
       " 'Rhona Mitra writes songs.',\n",
       " 'Steven Soderbergh directed a biographical film and received acclaim.',\n",
       " 'Dragon is taken from a linguistic system indigenous to sections of the Eastern Mediterranean.',\n",
       " 'Dragon is taken from a linguistic system indigenous to sections of the Eastern Mediterranean.',\n",
       " 'Following a stroke, Lauren Bacall died.',\n",
       " 'Led Zeppelin II was only released in Japan on October 31, 1969.',\n",
       " 'Brian Helgeland won an award.',\n",
       " 'De Profundis was written during an imprisonment.',\n",
       " \"Planet of the Apes' director was Franklin J. Schaffner.\",\n",
       " 'Radioactive has won a Grammy.',\n",
       " 'The hero of the Odyssey is Harry Potter.',\n",
       " 'Houston economy is incapable of having a base in energy.',\n",
       " 'Nice & Slow was released after 1990.',\n",
       " 'Lewis Hamilton is a racecar driver in F1.',\n",
       " 'Ben Stiller did not direct or star in the film Zoolander.',\n",
       " 'Ben Stiller did not direct or star in the film Zoolander.',\n",
       " 'Nicole Scherzinger made progress towards the eventual creation of a clothing brand.',\n",
       " 'Turkey ended accession negotiations with the European Union.',\n",
       " 'Selena Gomez starred in the 2013 film Spring Breakers.',\n",
       " 'Selena Gomez starred in the 2013 film Spring Breakers.',\n",
       " 'One of the leads in Transformers: Age of Extinction is an American rapper.',\n",
       " 'One of the leads in Transformers: Age of Extinction is an American rapper.',\n",
       " 'Emilio Estevez acts.',\n",
       " 'The Gheg of southern Austria form the oldest continuous ethnic Albanian diaspora.',\n",
       " 'Mauritius has high political freedom.',\n",
       " 'Star vs. the Forces of Evil is an American animated series produced by Disney Television Animation.',\n",
       " 'Before the year 2000, The Ren & Stimpy Show was created.',\n",
       " \"Krysten Ritter was on 'Til Death.\",\n",
       " 'The Incredible Hulk is the second episode in a series.',\n",
       " 'A Perfect Circle was formed in a year.',\n",
       " 'Farrah Fawcett forfeited four additional Golden Globe nominations for her 1980s work in TV movies.',\n",
       " 'Judy Greer has not appeared in multiple films.',\n",
       " '25 was released in November and was successful.',\n",
       " 'There is an actress name Eliza Dushka.',\n",
       " 'Little Mix is a Ugandan girl group.',\n",
       " 'Zindagi Na Milegi Dobara has a director named Laila.',\n",
       " 'Baahubali: The Beginning was released in 2000.',\n",
       " 'Miley Cyrus is in the music industry.',\n",
       " 'Miley Cyrus is in the music industry.',\n",
       " 'Miley Cyrus is in the music industry.',\n",
       " 'Miley Cyrus is in the music industry.',\n",
       " 'Miley Cyrus is in the music industry.',\n",
       " 'Christina Aguilera has avoided the music industry entirely.',\n",
       " 'Bill Gates was a chairman of Microsoft.',\n",
       " 'Keanu Reeves played bass guitar for the band Becky in 2001.',\n",
       " 'Gone with the Wind is a long-length fiction work.',\n",
       " 'Gone with the Wind is a long-length fiction work.',\n",
       " 'Gold has a distinctive color.',\n",
       " 'Lodging is done in a car.',\n",
       " 'K-pop Star 2 featured Park Jin-young as a judge.',\n",
       " 'The Khmer Empire was weak.',\n",
       " 'Gwen Stefani received a World Music Award.',\n",
       " \"Buddy Holly's birth name was Johnny Bravo.\",\n",
       " 'Liev Schreiber is an American actor.',\n",
       " 'Oakland, California is a city populated by 419,267 people.',\n",
       " 'Alex Rodriguez is an athlete.',\n",
       " \"Nazi Germany happened after Hitler's death.\",\n",
       " \"Keturah was Abraham's wife.\",\n",
       " 'Game of Thrones (season 1) featured Scottish stage and television actor Iain Glen.',\n",
       " 'Game of Thrones (season 1) featured Scottish stage and television actor Iain Glen.',\n",
       " 'Patrick Bateman is the villain protagonist of the game American Psycho.',\n",
       " 'Jimmy Carter was not a president.',\n",
       " 'Andy Dwyer appears in a series.',\n",
       " 'Andy Dwyer appears in a series.',\n",
       " 'Extracorporeal shockwave therapy (ESWT) is unused in cardiology.',\n",
       " 'Yusuke Murata was the illustrator of an American football manga.',\n",
       " 'There is a director named Fred Savage.',\n",
       " 'Where the Wild Things Are was put out in December.',\n",
       " 'Faith Evans works solely as an actress.',\n",
       " 'Hot was by a pop singer from Britain.',\n",
       " 'Natalie Portman was not in Star Wars.',\n",
       " 'Havoc went to the public on November 29, 2005.',\n",
       " 'Gabriel Aubry and Halle Berry have a child.',\n",
       " 'Sharon Tate was a model.',\n",
       " 'Nick Kroll has a leading role in the comedy Get Him to the Greek.',\n",
       " 'Inhumans are DC characters.',\n",
       " 'Cloud Atlas has been described as \"a sort of pointillist mosaic.\"',\n",
       " \"Thirteen is based on Nikki Reed's death at age 12 and 13.\",\n",
       " 'Caitlyn Jenner did not change her gender.',\n",
       " 'James Taylor released a compilation album.',\n",
       " 'James Taylor released a compilation album.',\n",
       " 'Slovakia joined in Eurozone in November 2009.',\n",
       " 'Little Boy was dropped by Enola Gay.',\n",
       " 'Taylor Schilling in the main cast of the series Orange is the New Black.',\n",
       " 'Curse, Inc. is used by a game.',\n",
       " 'Huginn is a raven that often travels with Odin.',\n",
       " 'Iain Glen is only a film actor.',\n",
       " 'The Billboard charts included Just Dance.',\n",
       " 'Mickey Rooney was in a film based on the novel The Black Stallion by Walter Farley.',\n",
       " 'Mickey Rooney was in a film based on the novel The Black Stallion by Walter Farley.',\n",
       " 'Louise Simonson is from America.',\n",
       " 'Nelson Mandela was President of South Africa from 1994 to 1999.',\n",
       " 'Janet Varney is a German.',\n",
       " 'Lust for Life is based on a 1934 novel.',\n",
       " 'Alex Rodriguez has had a 22-year career.',\n",
       " 'Lee Min-ho is a German singer.',\n",
       " \"Destiny's criticism centered mostly around the game's storyline and post-campaign content.\",\n",
       " 'No artists lived in Amsterdam.',\n",
       " 'Australia is a country in the Pacific Ocean.',\n",
       " 'Australia is a country in the Pacific Ocean.',\n",
       " 'Event management includes decor.',\n",
       " 'The New York Giants play professionally.',\n",
       " 'Shawn Mendes is represented by a Canadian record label.',\n",
       " 'Shawn Mendes is represented by a Canadian record label.',\n",
       " 'The Secret Life of Us failed to ever air anywhere.',\n",
       " 'The Dark Knight is set in Metropolis.',\n",
       " 'Jamie Foxx was incapable of portraying Ray Charles in Ray.',\n",
       " 'A cause of anti-nuclear antibodies are are anti-sp100 antibodies.',\n",
       " 'Emmy Rossum had a prominent role in a movie of which Maggie Greenwald was the director.',\n",
       " 'Emmy Rossum had a prominent role in a movie of which Maggie Greenwald was the director.',\n",
       " 'The divine right of kings was brought into action by Henry VIII when he changed the English constitution.',\n",
       " 'How to Lose Friends & Alienate People stars Simon Pegg, Kirsten Dunst, Danny Huston, Gillian Anderson, Megan Fox and Jeff Bridges, alongside Max Minghella and Margo Stilley.',\n",
       " 'Equidae includes some species known only from fossils.',\n",
       " 'Ty Cobb was born in rural Connecticut.',\n",
       " 'Psychological findings link to research and perspectives from an academic discipline.',\n",
       " 'Psychological findings link to research and perspectives from an academic discipline.',\n",
       " 'Felicity Jones was nominated for an Academy Award for Best Actress.',\n",
       " 'There is a screenwriter named Jim Rash.',\n",
       " 'Paris hosts the French Open.',\n",
       " 'Toy Story is a television show.',\n",
       " 'Kalpana Raghavendar is a person who writes songs.',\n",
       " 'The Odia language is used to communicate in Chhattisgarh.',\n",
       " 'Melisandre was left out of A Storm of Swords (2000).',\n",
       " 'Queen Latifah has won at least one Screen Actors Guild Award.',\n",
       " 'Laadla was released.',\n",
       " \"Stars Dance is Selena Gomez's debut album.\",\n",
       " \"Ileana D'Cruz starred in a movie.\",\n",
       " \"Ileana D'Cruz starred in a movie.\",\n",
       " \"Ileana D'Cruz starred in a movie.\",\n",
       " \"Ileana D'Cruz starred in a movie.\",\n",
       " \"Ileana D'Cruz starred in a movie.\",\n",
       " 'Jet Li was in The Forbidden Kingdom with Jackie Chan.',\n",
       " 'Suits stars a dog named Harvey Specter.',\n",
       " 'Dr. Dre established his own country.',\n",
       " 'Derrick Rose was not born in the Chicago area.',\n",
       " 'Paul Newman was an actor.',\n",
       " 'Charles I of England was a pauper.',\n",
       " 'SF are the initials used to represent San Francisco.',\n",
       " 'Billy Clanton was unrelated to Newman Clanton.',\n",
       " 'Katherine Heigl appeared in a science fiction television series.',\n",
       " 'Katherine Heigl appeared in a science fiction television series.',\n",
       " 'Stagira is the birthplace of Plato.',\n",
       " 'Cara Delevinge did not win the Model of the Year award.',\n",
       " 'David Harbour was born on June 2nd, 1991.',\n",
       " 'In Burundi, there are 21 registered parties.',\n",
       " 'Where the Wild Things Are was released in Australia.',\n",
       " 'Furious 7 is a TV show.',\n",
       " 'Sarah Paulson received a Golden Globe Award nomination.',\n",
       " 'Caroline, Princess of Hanover is married to anyone but an heir.',\n",
       " \"Grey's Anatomy is filmed in the United States.\",\n",
       " \"Grey's Anatomy is filmed in the United States.\",\n",
       " 'Nikolaj Coster-Waldau was not in a Danish thriller film.',\n",
       " 'Nikolaj Coster-Waldau was not in a Danish thriller film.',\n",
       " 'Sean Connery won three Golden Globes.',\n",
       " 'Gujarat is in Western Boston.',\n",
       " 'Cancer is a group of diseases involving abnormal cell proliferation.',\n",
       " 'Marion Cotillard portrayed someone.',\n",
       " 'Chandni was created in 2001.',\n",
       " 'Ronald Reagan worked for the president of the United States.',\n",
       " 'Kill Bill: Volume 2 is about the Bride continuing her revenge against Bill.',\n",
       " 'Music journalism is critical of popular music topics.',\n",
       " 'Tom Felton is an actor.',\n",
       " \"The Marvel Cinematic Universe's first phase ended.\",\n",
       " \"Hulk's coloration has not varied.\",\n",
       " 'Roger Federer avoided tennis entirely.',\n",
       " 'Andy Kaufman was an artist.',\n",
       " 'Bruce Springsteen was a Kennedy Center Honors recipient in 2009.',\n",
       " 'Planet of the Apes is a squid.',\n",
       " 'Hayden Panettiere is a person.',\n",
       " 'A Song of Ice and Fire is by George Raymond Richard Martin.',\n",
       " 'A Song of Ice and Fire is by George Raymond Richard Martin.',\n",
       " 'Oh Yeon-seo worked in a group.',\n",
       " 'Mango is the national fruit of the Philippines.',\n",
       " 'George Best has been described as \"the worst player to ever pull on the green shirt of Wales.\"',\n",
       " 'Bring It On (film) had zero involvement from Jesse Bradford.',\n",
       " 'Roald Dahl writes books.',\n",
       " 'Hypothyroidism can cause mood changes.',\n",
       " 'Jon Watts has only ever been a plumber.',\n",
       " 'Cosmopolitan as of 2011 only contains content which includes articles on dogs.',\n",
       " 'By area, Nepal is the ninety-third largest country on Earth.',\n",
       " 'Wentworth premiered on Broadway.',\n",
       " 'The Fujitsu iPAD was introduced by Fujitsu in 2002.',\n",
       " 'Cage Warriors is an MMA promotion that held its first event in London.',\n",
       " 'American Horror Story: Hotel is a season of an FX romance serialized radio series.',\n",
       " 'Lonesome Dove (miniseries) was nominated for eighteen Emmys in 1989 and won seven.',\n",
       " 'Denial was released in Europe.',\n",
       " 'Denial was released in Europe.',\n",
       " \"Avatar: The Last Airbender's antagonist is Aang.\",\n",
       " 'Apple was not founded in 1976.',\n",
       " 'Conquest of the Planet of the Apes is genre fiction.',\n",
       " 'Conquest of the Planet of the Apes is genre fiction.',\n",
       " ...]"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "claims"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "def generate_all_tokens(arr):\n",
    "    all_tokens = []\n",
    "    for unprocessed_claim in tqdm_notebook(arr):\n",
    "        c = utils.preprocess_article_name(unprocessed_claim)\n",
    "        c = \"! {} !\".format(c)\n",
    "        for word in c.split():\n",
    "            letter_tuples = list(nltk.ngrams(\"#\" + word + \"#\", 3))\n",
    "            letter_grams = []\n",
    "            for l in letter_tuples:\n",
    "                letter_grams.append(\"\".join(l))\n",
    "            all_tokens.extend(letter_grams)\n",
    "    return all_tokens"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "0dc2d9a5b7fc4c5bb6bf4066e71f3454",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(IntProgress(value=0, max=125051), HTML(value='')))"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "2d641ceb063844f1aa9d24e8fc7bdcfe",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(IntProgress(value=0, max=125051), HTML(value='')))"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "LabelEncoder()"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "processed_claims = generate_all_tokens(claims)\n",
    "processed_claims.extend(generate_all_tokens(article_list))\n",
    "\n",
    "possible_tokens = list(set(processed_claims))\n",
    "\n",
    "encoder = LabelEncoder()\n",
    "encoder.fit(np.array(sorted(possible_tokens)))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "07ed645cb2dd4cd7b80b55f4c169398a",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(IntProgress(value=1, bar_style='info', max=1), HTML(value='')))"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n"
     ]
    }
   ],
   "source": [
    "feature_encoder = {}\n",
    "for idx, e in tqdm_notebook(enumerate(encoder.classes_)):\n",
    "    feature_encoder[e] = idx"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "def tokenize_claim(c, enc):\n",
    "    \"\"\"\n",
    "    Input: a string that represents a single claim\n",
    "    Output: a list of 3x|vocabulary| arrays that has a 1 where the letter-gram exists.\n",
    "    \"\"\"\n",
    "    encoded_vector = []\n",
    "    c = utils.preprocess_article_name(c)\n",
    "    c = \"! {} !\".format(c)\n",
    "    for ngram in nltk.ngrams(nltk.word_tokenize(c), 3):\n",
    "        arr = sparse.lil_matrix((3, len(enc.__dict__['classes_'])))\n",
    "        for idx, word in enumerate(ngram):\n",
    "            for letter_gram in nltk.ngrams(\"#\" + word + \"#\", 3):\n",
    "                s = \"\".join(letter_gram)\n",
    "                letter_idx = feature_encoder[s]\n",
    "                arr[idx, letter_idx] = 1\n",
    "        encoded_vector.append(arr)\n",
    "    return encoded_vector"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "load_processed_claims = True"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "if load_processed_claims:\n",
    "    with open(\"all_data.pkl\", \"rb\") as f:\n",
    "        all_data = pickle.load(f)\n",
    "else:\n",
    "    all_data = []\n",
    "\n",
    "    article_set = set(article_list)\n",
    "\n",
    "    def process_claim(idx):\n",
    "        data = {}\n",
    "        data['claim'] = tokenize_claim(claims[idx], encoder)\n",
    "        data['positive_article'] = tokenize_claim(article_list[idx], encoder)\n",
    "        negative_articles = np.random.choice(list(article_set - set(claim_to_article[claims[idx]])), cdssm.J)\n",
    "        negative_articles = [tokenize_claim(i, encoder) for i in negative_articles]\n",
    "        data['negative_article'] = negative_articles\n",
    "        return data\n",
    "\n",
    "    all_data = [process_claim(i) for i in tqdm_notebook(range(len(claims)))]\n",
    "    \n",
    "    with open(\"all_data.pkl\", \"wb\") as f:\n",
    "        pickle.dump(all_data, f)\n",
    "    #all_data = Parallel(n_jobs=cpu_count(), verbose=1, prefer=\"threads\")(delayed(process_claim)(i) for i in range(len(claims)))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "import torch \n",
    "import torch.nn as nn\n",
    "import torchvision.datasets as dsets\n",
    "import torchvision.transforms as transforms\n",
    "from torch.autograd import Variable\n",
    "import torch.nn.functional as F\n",
    "import cdssm"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "model = cdssm.CDSSM()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "def to_torch_sparse_tensor(M):\n",
    "    M = M.tocoo().astype(np.float32)\n",
    "    indices = torch.from_numpy(np.vstack((M.row, M.col))).long().cuda()\n",
    "    values = torch.from_numpy(M.data).cuda()\n",
    "    shape = torch.Size(M.shape)\n",
    "    T = torch.sparse.FloatTensor(indices, values, shape)\n",
    "    return T"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "scrolled": true
   },
   "outputs": [],
   "source": [
    "all_gpu_data = []\n",
    "def process_gpu_data(i):\n",
    "    data = {}\n",
    "    data['claim'] = Variable(to_torch_sparse_tensor(sparse.vstack(all_data[i]['claim'])))\n",
    "    data['positive_article'] = Variable(to_torch_sparse_tensor(sparse.vstack(all_data[i]['positive_article'])))\n",
    "    data['negative_article'] = [_ for j in range(cdssm.J)]\n",
    "    for j in range(cdssm.J):\n",
    "        item = all_data[i]['negative_article'][j]\n",
    "        if len(item)>0:\n",
    "            data['negative_article'][j] = Variable(to_torch_sparse_tensor(sparse.vstack(all_data[i]['negative_article'][j])))\n",
    "    return data\n",
    "\n",
    "all_gpu_data = Parallel(n_jobs=cpu_count(), verbose=1, prefer=\"threads\")(delayed(process_gpu_data)(i) for i in range(10000))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "all_gpu_data[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "ffeb6b815f3e497cbb08e99423e40542",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(IntProgress(value=0, max=125049), HTML(value='')))"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n"
     ]
    }
   ],
   "source": [
    "all_gpu_data = []\n",
    "for i in tqdm_notebook(range(1, len(all_data))):\n",
    "    data = {}\n",
    "    data['claim'] = Variable(to_torch_sparse_tensor(sparse.vstack(all_data[i]['claim'])))\n",
    "    data['positive_article'] = Variable(to_torch_sparse_tensor(sparse.vstack(all_data[i]['positive_article'])))\n",
    "    data['negative_article'] = [_ for j in range(cdssm.J)]\n",
    "    for j in range(cdssm.J):\n",
    "        item = all_data[i]['negative_article'][j]\n",
    "        if len(item)>0:\n",
    "            data['negative_article'][j] = Variable(to_torch_sparse_tensor(sparse.vstack(all_data[i]['negative_article'][j])))\n",
    "    all_gpu_data.append(data)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "LETTER_GRAM_SIZE = 3 # See section 3.2.\n",
    "WINDOW_SIZE = 3 # See section 3.2.\n",
    "TOTAL_LETTER_GRAMS = len(encoder.__dict__['classes_']) # Determined from data. See section 3.2.\n",
    "WORD_DEPTH = WINDOW_SIZE * TOTAL_LETTER_GRAMS # See equation (1).\n",
    "# Uncomment it, if testing\n",
    "# WORD_DEPTH = 1000\n",
    "K = 300 # Dimensionality of the max-pooling layer. See section 3.4.\n",
    "L = 128 # Dimensionality of latent semantic space. See section 3.5.\n",
    "J = 4 # Number of random unclicked documents serving as negative examples for a query. See section 4.\n",
    "FILTER_LENGTH = 1 # We only consider one time step for convolutions."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Loss and optimizer\n",
    "criterion = torch.nn.CrossEntropyLoss()\n",
    "optimizer = torch.optim.SGD(model.parameters(), lr=1e-4, momentum=0.9)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Build a random data set.\n",
    "train_set_size = int(len(all_gpu_data) * 0.8)\n",
    "\n",
    "for i in tqdm_notebook(range(train_set_size)):\n",
    "    claim = all_gpu_data[i]['claim'].to_dense()\n",
    "    claim = claim.view(1, claim.shape[0] // 3, 3, -1)\n",
    "    \n",
    "    positive_article = all_gpu_data[i]['positive_article'].to_dense()\n",
    "    positive_article = positive_article.view(1, positive_article.shape[0] // 3, 3, -1)\n",
    "    \n",
    "    negative_articles = []\n",
    "    for j in range(cdssm.J):\n",
    "        negative_article = all_gpu_data[i]['negative_article'][j].to_dense()\n",
    "        negative_article = negative_article.view(1, negative_article.shape[0]//3, 3, -1)\n",
    "        negative_articles.append(negative_article)\n",
    "    \n",
    "    y_pred = model(claim, positive_article, negative_articles)\n",
    "    \n",
    "    y = Variable(torch.from_numpy(np.array(labels[i])).long())\n",
    "    loss = criterion(y_pred.resize(1,cdssm.J+1), y)\n",
    "    print (i, loss.data[0])\n",
    "    optimizer.zero_grad()\n",
    "    loss.backward()\n",
    "    optimizer.step()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}
